-- Logs begin at Wed 2022-05-04 17:58:45 UTC, end at Wed 2022-05-04 19:16:41 UTC. -- May 04 18:42:13.978061 dv-cinder-840525-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 18:42:13.986207 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 18:42:13.988835 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 18:42:13 2022] *** May 04 18:42:13.989020 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 18:42:13.989177 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 18:42:13.989328 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: nodename: dv-cinder-840525-1-iscsi May 04 18:42:13.989433 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: machine: x86_64 May 04 18:42:13.989555 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: clock source: unix May 04 18:42:13.989555 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: pcre jit disabled May 04 18:42:13.989555 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: detected number of CPU cores: 4 May 04 18:42:13.989555 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: current working directory: / May 04 18:42:13.989555 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: detected binary path: /usr/bin/uwsgi-core May 04 18:42:13.989555 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: your processes number limit is 47680 May 04 18:42:13.989555 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: your memory page size is 4096 bytes May 04 18:42:13.989555 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: detected max file descriptor number: 2048 May 04 18:42:13.989555 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: lock engine: pthread robust mutexes May 04 18:42:13.990101 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: thunder lock: enabled May 04 18:42:13.990101 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 18:42:13.990101 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 18:42:14.033708 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: Python main interpreter initialized at 0x55d3e7d1f9c0 May 04 18:42:14.033708 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: python threads support enabled May 04 18:42:14.033708 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: your server socket listen backlog is limited to 100 connections May 04 18:42:14.033708 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: your mercy for graceful operations on workers is 90 seconds May 04 18:42:14.034082 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: mapped 403077 bytes (393 KB) for 2 cores May 04 18:42:14.034082 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: *** Operational MODE: preforking *** May 04 18:42:14.034387 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: *** uWSGI is running in multiple interpreter mode *** May 04 18:42:14.034387 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: spawned uWSGI master process (pid: 79814) May 04 18:42:14.034549 dv-cinder-840525-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 18:42:14.036959 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: spawned uWSGI worker 1 (pid: 79826, cores: 1) May 04 18:42:14.036959 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: spawned uWSGI worker 2 (pid: 79827, cores: 1) May 04 18:42:14.036959 dv-cinder-840525-1-iscsi devstack@keystone.service[79814]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 18:42:19.677361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:42:19.677361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: from cryptography.utils import int_from_bytes May 04 18:42:19.678179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:42:19.678179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: from cryptography.utils import int_from_bytes May 04 18:42:19.678287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:42:19.678287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: from cryptography.utils import int_from_bytes May 04 18:42:19.678287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:42:19.678287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: from cryptography.utils import int_from_bytes May 04 18:42:19.727129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 18:42:19.727312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 18:42:19.727683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] command line args: [] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 18:42:19.727782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 18:42:19.727847 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 18:42:19.728050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 18:42:19.728169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ================================================================================ {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 18:42:19.728261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] command line args: [] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 18:42:19.728337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] admin_token = **** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.728407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 18:42:19.728407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ================================================================================ {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 18:42:19.728581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] config_dir = [] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.728652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] admin_token = **** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.728800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.728881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] config_dir = [] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.728961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] config_source = [] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.729035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.729186 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] debug = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.729258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] config_source = [] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.730743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.730988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] debug = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.730988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] list_limit = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] log_config_append = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] list_limit = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] log_config_append = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] log_dir = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.732969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] log_dir = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.733086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] log_file = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.733144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] log_file = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.733206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.733263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.733865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.734014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.734155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.734281 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.734405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.734533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.734671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.734798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.734933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.735069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.735203 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.735329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.735460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.735591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.735728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.735886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.736022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.736155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.736297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.736430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.736562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.736750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.736887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.737018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.737146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.737299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.737432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.737559 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.737685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.737818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.737957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] publish_errors = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.738100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] publish_errors = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.738227 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.738358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.738483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.738607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.738737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.738861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.738993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.739177 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.739318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.739449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.739574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] standard_threads = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.739704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] standard_threads = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.739837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.739979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.740104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.740229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.740360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.740485 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.740618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] use_journal = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.740749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] use_journal = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.740881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] use_json = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.741012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] use_json = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.741137 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] use_stderr = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.741362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] use_stderr = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.741507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] use_syslog = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.741702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] use_syslog = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.741857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.741985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:42:19.742109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.742232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.742366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.742492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.742615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.742739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.742863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.742992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.743130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.743256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.743416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.743551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.743689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.743892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.744020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.744150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.744281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.744406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.744537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.744672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.744798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.744923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.745046 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.745169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.745346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.745492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.745630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.745755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.745879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.746002 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.746126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.746262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.746389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.746513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.746644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.746769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.746892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.747024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.747149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.747282 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.747407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.747536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.747662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.747793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.747918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.748043 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.748166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.748289 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.748412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.748547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.748677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.748800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.748940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.749069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.749199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.749361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.749491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.749616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.749740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.749869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.750309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.750517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.750651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.750776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.750906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.751042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.751177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.751311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.751442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.751567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.751691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.751822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.751952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.752086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.752212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.752335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.752459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.752588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.752720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.752720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.752975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.753100 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.753224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.753368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.753508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.753634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.753764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.753894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.754024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.754148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.754279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.754404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.754528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.755731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.755900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.756206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.756411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.756576 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.756768 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.756954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.757141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.757375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.757570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.757760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.758007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.758208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.758377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.758560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.758752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.758938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.759124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.759347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.759532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.759715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.759934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.760094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.760278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.760468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.760653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.760820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.760957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.761125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.761260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.761444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.761583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.761716 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.761843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.761976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.762141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.762273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.762399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.762524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.762649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.762784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.762919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.763045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.763170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.763295 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.763448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.763581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.763714 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.763840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.763965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.764089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.764213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.764425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.764602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.764733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.764858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.764983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.765108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.765241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.765419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.765549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.765674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.765798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.765929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.766094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.766322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.766461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.766461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.766712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.766838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.766963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.767103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.767231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.767357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.767481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.767607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.767740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.767867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.767992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.768118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.768259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.768385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.768519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.768647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.768785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.768912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.769052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.769179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.769344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.769486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.769625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.769758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.769884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.770009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.770145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.770270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.770404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.770530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.770656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.770781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.770906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.771083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.771226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.771353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.771478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.771603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.771729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.771854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.771998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.772125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.772250 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.772375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.772499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.772624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] auth.external = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.772624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.772870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.772870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.773107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.773233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] auth.external = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.773390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.773550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.773699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] auth.password = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.773699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] auth.token = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.773960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.774092 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.774227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.774355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.774482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] auth.password = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.774618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.774745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] auth.token = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.774879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.775006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.775132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.775267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.775267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.775518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.775518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.775757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.775882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] credential.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.776017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.776147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.776272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.776397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.776523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.776649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.776782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] credential.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.776916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.777044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.777180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.777363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.777497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.777634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.777762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.777888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.778014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.778139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.778264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.778398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.778526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.778651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.778785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.778912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.779060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.779267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.779267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.779525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.779525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.779763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.779891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.780025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.780154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] federation.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.780280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.780406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.780531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.780656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.780790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.780934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.781068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] federation.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.781198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.781341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.781481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.781684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.781814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.781941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.782075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.782203 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.782331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.782464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.782593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.782731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.782863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.782991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.783117 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.783256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.783384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.783509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.783636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.783797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.783929 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.784065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.784193 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.784321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.784447 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.784584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.784717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.784852 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.784979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.785106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.785232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.785381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.785510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.785648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.785776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.785908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.786035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.786162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.786303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.786448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.786577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.786709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.786836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.786963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.787096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.787224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.787408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.787540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.787673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.787800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.787934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.788062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.788200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.788327 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.788459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.788587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.788722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.788849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.789023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.789155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.789296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.789296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.789553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.789681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.789807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.789949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.790076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.790076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.790321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.790454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.790587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.790720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.790846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.790971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.791108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.791236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.791361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.791361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.791598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.791598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.791863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.791990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.792117 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.792242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.792377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.792504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.792644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.792644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.792885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.793011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.793136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.793268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.793506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.793636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.793763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.793889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.794015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.794141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.794274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.794401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.794526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.794652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.794779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.794904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.795038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.795165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.795304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.795431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.795565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.795692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.795869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.796003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.796131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.796257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.796383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.796508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.796642 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.796770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.796896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.797022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.797158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.797300 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.797443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.797572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.797698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.797824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.797952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.798077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.798211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.798338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.798464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.798590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.798716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.798855 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.798996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.799127 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.799254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.799380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.799506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.799640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.799767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.799894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.800020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.800147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.800272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.800406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.800533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.800669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.800796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.800929 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.801063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.801200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.801343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.801474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.801603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.801729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.801854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.801991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.802120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.802246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.802371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.802514 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.802641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.802776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.802903 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.803030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.803156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.803283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.803409 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.803543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.803671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.803797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.803923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.804049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.804185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.804321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.804450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.804576 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.804703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.804828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.804954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.805088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.805215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.805360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.805489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.805616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.805741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.805878 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.806015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.806143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.806269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.806395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] resource.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.806521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.806722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.806851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.806978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.807103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.807229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.807356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.807490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.807618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] resource.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.807745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.807881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.808007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.808132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.808269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.808395 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.808522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.808522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.808760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.808885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] role.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.809025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.809155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] role.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.809344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.809480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.809607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.809743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.809881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.810009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.810137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.810263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.810389 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] role.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.810515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.810649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] role.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.810649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.810889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.811014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.811140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.811301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.811453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.811453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.811695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.811821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.811946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.812072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.812206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.812333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.812459 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.812585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.812712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.812845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.812973 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.812973 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.813221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.813368 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.813496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.813636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.813765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.813892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.814018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.814143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.814268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.814268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.814516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.814641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.814778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.814904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.815049 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.815296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.815443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.815573 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.815700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.815829 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.815956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.816096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.816225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.816352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.816478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.816615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.816742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.816878 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.817005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.817131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.817262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.817407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.817534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.817672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.817799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.817926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.818053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.818178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] token.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.818304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.818455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.818651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.818786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.818915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.819048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.819176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.819311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.819440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.819566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.819691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] token.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.819816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.819952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.820080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.820206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.820344 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.820472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.820598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.820732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.820860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.820987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.821113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.821237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.821385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.821523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.821651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.821777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.821902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.822040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.822167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.822306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.822434 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.822601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.822820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.822958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.823086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.connection = **** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.823226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.823363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.823499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.823627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.823754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.823880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.824017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.824145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.824281 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.824409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.824535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.connection = **** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.824671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.824807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.824935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.824935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.825182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.825182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.825449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.825576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.825702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.825839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.825977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.826104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.826238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.826371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.826503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.826636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.826777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.826911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.827044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.827044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.827298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.827432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.827637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.827785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.827919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.828053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 18:42:19.828186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.828186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.828186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.828186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.828186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.828186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:42:19.828186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 18:42:19.840986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.841208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.841595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.841754 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.841896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.841896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.850135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.850452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.878416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.878660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.878799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.878993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.930881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.931213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.981586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.981884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.988290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:19.988502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.048025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.048364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.048523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.048664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.048818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.048971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.049108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.049243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.049413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.049562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.049562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.049562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.072685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.072968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.073159 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.073349 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.073497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.073497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.073758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.073893 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.074040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.074177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.074312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.074312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.074567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.074567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.085199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.085732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.099778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.100101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.100270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.100411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.100551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.100686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.100823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.100968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.101106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.101256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.101425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.101563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.101563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.101831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 18:42:20.118148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.118371 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 18:42:20.118624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.118828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.119002 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 18:42:20.119145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 18:42:20.119145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.119418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.119554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.119688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 18:42:20.119833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.119971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.120106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.120240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.120240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.120501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.131001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.131307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.131548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.131709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.131849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.132005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.132143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.132417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.139889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.140533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.143171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.143450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.143699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.143846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.144094 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.144309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.144461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.144602 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.144602 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.144858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.144994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.145151 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.145326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.145483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.145621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.145756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.145903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.146040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.146177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.146312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.146312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.146574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.172562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.173168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.174194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.174479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.174826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.175084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.179746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.180021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.180285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.180570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.180803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.180951 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.187741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.188021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.188305 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.188592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.192611 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.192898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.193175 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.193264 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.193484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.193595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.193767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.193851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.194043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.194128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.194311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.194394 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.194557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.194639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.194849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.195113 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.213250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.213550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.213922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.214201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.218117 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.218794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.221883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.222172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.222450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.222749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.228420 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.229748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.233389 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.234389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.237120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.237442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.237728 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.238010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.238155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.238293 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.238521 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.238673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.238810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.238981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.239250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.239521 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.258017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.258398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.258665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.258892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.259050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.259265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.259530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.259787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.266820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.267567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.268554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.268831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.269242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.269537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.271967 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.272246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.272527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.272687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.272825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.272963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.273107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.273245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.273446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.273715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.286513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.286751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.286978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.287205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.287372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.287515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.287665 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.287804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.287940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.288085 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.288223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.288369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.288506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.288506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.306353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.306565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.309646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.309852 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.312956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.313158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.314565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.314782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.316196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.316399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.316563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.316704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.316841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.316992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.324065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.324270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.325671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.325874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.328844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.329047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.329196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.329391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.329534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.329673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.329827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.329965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.338833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.339129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.339333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.339501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.339645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.339782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.347178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.347455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.347837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.347960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 18:42:20.348119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.348325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.348410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.348583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.348762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.348847 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.348912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.349141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.349266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.349519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.349669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.349809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.349959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.350157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.350299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.350435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.350573 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.350710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.350804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.350804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.350918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.350980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.351274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.351606 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 18:42:20.389559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d3e7d1f9c0 pid: 79826 (default app) May 04 18:42:20.391014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d3e7d1f9c0 pid: 79827 (default app) May 04 18:42:20.393022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce34f0-7446-42ce-ac74-cc7e95d0887c None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:20.393332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce34f0-7446-42ce-ac74-cc7e95d0887c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:20.393610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce34f0-7446-42ce-ac74-cc7e95d0887c None None] PATH_INFO: `/v3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:20.397880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 791 bytes} [Wed May 4 18:42:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:28.402600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6342a-c209-48f7-a27b-a48f0c6b479c None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:28.403159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6342a-c209-48f7-a27b-a48f0c6b479c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:28.403159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6342a-c209-48f7-a27b-a48f0c6b479c None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:28.407669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1/2] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:42:28.412698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:28.413129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:28.413361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:28.445079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG oslo_db.sqlalchemy.engines [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:42:28.626594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG passlib.handlers.bcrypt [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79826) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 18:42:28.626998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG passlib.handlers.bcrypt [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79826) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 18:42:28.681509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:28.682997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:28.809431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 2/3] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 04 18:42:28.982571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6342a-c209-48f7-a27b-a48f0c6b479c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:29.018261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f6342a-c209-48f7-a27b-a48f0c6b479c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:42:29.147798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6342a-c209-48f7-a27b-a48f0c6b479c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:29.152541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a38d-e2e9-423f-8204-bf78ec9416e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:29.153211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a38d-e2e9-423f-8204-bf78ec9416e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:29.153637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a38d-e2e9-423f-8204-bf78ec9416e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:29.153912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a38d-e2e9-423f-8204-bf78ec9416e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:29.162385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6a38d-e2e9-423f-8204-bf78ec9416e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:29.212866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36d6a38d-e2e9-423f-8204-bf78ec9416e4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 18:42:29.213205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6a38d-e2e9-423f-8204-bf78ec9416e4 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:29.222831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 2/4] 10.222.0.35 () {58 vars in 1324 bytes} [Wed May 4 18:42:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:42:29.228799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:29.242990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc5734-6b26-4f6a-a15b-9d1052abdc2e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:29.248326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950c82d-40f2-4b08-9edf-8f0f2fb38995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:29.249494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950c82d-40f2-4b08-9edf-8f0f2fb38995 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:29.249776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950c82d-40f2-4b08-9edf-8f0f2fb38995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:29.250378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950c82d-40f2-4b08-9edf-8f0f2fb38995 admin admin] PATH_INFO: `/v3/projects/a4308e1d2b884e0c9079dd2577f0b370` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:29.252061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950c82d-40f2-4b08-9edf-8f0f2fb38995 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4308e1d2b884e0c9079dd2577f0b370)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:29.301579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9950c82d-40f2-4b08-9edf-8f0f2fb38995 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 18:42:29.301920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950c82d-40f2-4b08-9edf-8f0f2fb38995 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:29.306524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 3/5] 10.222.0.35 () {56 vars in 1207 bytes} [Wed May 4 18:42:29 2022] GET /identity/v3/projects/a4308e1d2b884e0c9079dd2577f0b370 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:31.504709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd9a3b-a32b-4750-a3f8-4f36bdfd95ba None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:31.505240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd9a3b-a32b-4750-a3f8-4f36bdfd95ba None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:31.505240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd9a3b-a32b-4750-a3f8-4f36bdfd95ba None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:31.509520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 3/6] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:31.515091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965fd4f-9ed6-4f32-b45e-6373d4e21dea None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:31.515899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965fd4f-9ed6-4f32-b45e-6373d4e21dea None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:31.516154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965fd4f-9ed6-4f32-b45e-6373d4e21dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:31.537236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-2965fd4f-9ed6-4f32-b45e-6373d4e21dea None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:31.538804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2965fd4f-9ed6-4f32-b45e-6373d4e21dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:31.547825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 4/7] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 18:42:31.570235 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd9a3b-a32b-4750-a3f8-4f36bdfd95ba None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:31.584252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd9a3b-a32b-4750-a3f8-4f36bdfd95ba None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:31.588947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bd79e-7a12-445c-b60b-fea6896e81ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:31.589608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bd79e-7a12-445c-b60b-fea6896e81ee admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:31.589890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bd79e-7a12-445c-b60b-fea6896e81ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:31.590161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bd79e-7a12-445c-b60b-fea6896e81ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:31.597779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bd79e-7a12-445c-b60b-fea6896e81ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:31.599515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bd79e-7a12-445c-b60b-fea6896e81ee admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:31.608285 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 4/8] 10.222.0.35 () {58 vars in 1324 bytes} [Wed May 4 18:42:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:42:31.613551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965fd4f-9ed6-4f32-b45e-6373d4e21dea None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:31.622703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965fd4f-9ed6-4f32-b45e-6373d4e21dea None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:31.628732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768f704-49d3-4268-9506-89b594549d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:31.629642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768f704-49d3-4268-9506-89b594549d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:31.629921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768f704-49d3-4268-9506-89b594549d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:31.630194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768f704-49d3-4268-9506-89b594549d53 admin admin] PATH_INFO: `/v3/users/03485317eebc406bacc978bde43ff42a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:31.631695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768f704-49d3-4268-9506-89b594549d53 admin admin] RBAC: Authorizing `identity:get_user(user_id=03485317eebc406bacc978bde43ff42a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:31.633565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768f704-49d3-4268-9506-89b594549d53 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:31.635134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 5/9] 10.222.0.35 () {56 vars in 1198 bytes} [Wed May 4 18:42:31 2022] GET /identity/v3/users/03485317eebc406bacc978bde43ff42a => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:33.905568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff446b-e469-4440-886d-bb96be6193c1 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:33.906128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff446b-e469-4440-886d-bb96be6193c1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:33.906128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff446b-e469-4440-886d-bb96be6193c1 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:33.907416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 5/10] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:33.912758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0fe0-fceb-44ba-acf9-8c863e26764f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:33.913186 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0fe0-fceb-44ba-acf9-8c863e26764f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:33.913307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0fe0-fceb-44ba-acf9-8c863e26764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:33.959283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d7a93-8edc-45d7-86f1-cef019b4714e None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:33.959540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d7a93-8edc-45d7-86f1-cef019b4714e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:33.960010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d7a93-8edc-45d7-86f1-cef019b4714e None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:33.961380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 6/11] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:42:33.967341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd95c52-52ae-4209-92c9-f62704d2f2a2 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:33.967678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd95c52-52ae-4209-92c9-f62704d2f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:33.967899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd95c52-52ae-4209-92c9-f62704d2f2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:34.010010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG passlib.handlers.bcrypt [None req-afd95c52-52ae-4209-92c9-f62704d2f2a2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79827) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 18:42:34.010388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG passlib.handlers.bcrypt [None req-afd95c52-52ae-4209-92c9-f62704d2f2a2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79827) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 18:42:34.040142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-bdee0fe0-fceb-44ba-acf9-8c863e26764f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:34.041319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-bdee0fe0-fceb-44ba-acf9-8c863e26764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:34.056548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-afd95c52-52ae-4209-92c9-f62704d2f2a2 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:34.058153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-afd95c52-52ae-4209-92c9-f62704d2f2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:34.120071 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 6/12] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:34.143054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0fe0-fceb-44ba-acf9-8c863e26764f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:34.158686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 7/13] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:34.180342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd95c52-52ae-4209-92c9-f62704d2f2a2 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:34.241588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0fe0-fceb-44ba-acf9-8c863e26764f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:34.280458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd95c52-52ae-4209-92c9-f62704d2f2a2 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:34.282610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e946078-dc3c-49d3-a0ea-d699e9553af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:34.283913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e946078-dc3c-49d3-a0ea-d699e9553af1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:34.283913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e946078-dc3c-49d3-a0ea-d699e9553af1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:34.284080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e946078-dc3c-49d3-a0ea-d699e9553af1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:34.296314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e946078-dc3c-49d3-a0ea-d699e9553af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8e946078-dc3c-49d3-a0ea-d699e9553af1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:34.307609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:34.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:42:34.314381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 7/14] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:42:34.315267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e946078-dc3c-49d3-a0ea-d699e9553af1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:34.324382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706aea09-5451-4220-ac99-1a9974c92fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:34.325363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aea09-5451-4220-ac99-1a9974c92fb6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:34.325654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aea09-5451-4220-ac99-1a9974c92fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:34.325930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aea09-5451-4220-ac99-1a9974c92fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:34.395426 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706aea09-5451-4220-ac99-1a9974c92fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:34.397007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706aea09-5451-4220-ac99-1a9974c92fb6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:34.419144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e946078-dc3c-49d3-a0ea-d699e9553af1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:34.451993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2cdf3-4bf7-4136-8921-f7c128844208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:34.452677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2cdf3-4bf7-4136-8921-f7c128844208 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:34.452957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2cdf3-4bf7-4136-8921-f7c128844208 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:34.453231 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2cdf3-4bf7-4136-8921-f7c128844208 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:34.454041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2cdf3-4bf7-4136-8921-f7c128844208 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:34.454352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2cdf3-4bf7-4136-8921-f7c128844208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:34.455750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2cdf3-4bf7-4136-8921-f7c128844208 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:34.468196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 8/15] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:34.473612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2cdf3-4bf7-4136-8921-f7c128844208 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:34.497569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 8/16] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:42:34.503786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706aea09-5451-4220-ac99-1a9974c92fb6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:34.576653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2cdf3-4bf7-4136-8921-f7c128844208 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:34.602605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706aea09-5451-4220-ac99-1a9974c92fb6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:34.611963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99787e33-b88f-4a8d-891f-2c6c8bcd5eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:34.612854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99787e33-b88f-4a8d-891f-2c6c8bcd5eb7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:34.613136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99787e33-b88f-4a8d-891f-2c6c8bcd5eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:34.613441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99787e33-b88f-4a8d-891f-2c6c8bcd5eb7 None admin] PATH_INFO: `/v3/users/03485317eebc406bacc978bde43ff42a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:34.614676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99787e33-b88f-4a8d-891f-2c6c8bcd5eb7 None admin] RBAC: Authorizing `identity:get_user(user_id=03485317eebc406bacc978bde43ff42a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:34.616217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99787e33-b88f-4a8d-891f-2c6c8bcd5eb7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:34.618097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 9/17] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:34 2022] GET /identity/v3/users/03485317eebc406bacc978bde43ff42a => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:34.623184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99787e33-b88f-4a8d-891f-2c6c8bcd5eb7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:34.636333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fe1fa-67f1-4c52-ab40-ed7f884cadf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:34.637135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fe1fa-67f1-4c52-ab40-ed7f884cadf2 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:34.637461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fe1fa-67f1-4c52-ab40-ed7f884cadf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:34.637735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fe1fa-67f1-4c52-ab40-ed7f884cadf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:34.732298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99787e33-b88f-4a8d-891f-2c6c8bcd5eb7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:34.766863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fe1fa-67f1-4c52-ab40-ed7f884cadf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:34.768287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fe1fa-67f1-4c52-ab40-ed7f884cadf2 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:34.770096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfd730-9de3-4848-8636-3310732d2a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:34.771469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfd730-9de3-4848-8636-3310732d2a63 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:34.771939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfd730-9de3-4848-8636-3310732d2a63 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:34.772393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfd730-9de3-4848-8636-3310732d2a63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:34.773824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfd730-9de3-4848-8636-3310732d2a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:34.775838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfd730-9de3-4848-8636-3310732d2a63 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:34.778366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 10/18] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:34.784095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfd730-9de3-4848-8636-3310732d2a63 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-373fe1fa-67f1-4c52-ab40-ed7f884cadf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:42:34.789373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:34.790222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:34.791051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:42:34.791051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:42:34.791051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:42:34.791051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:42:34.795377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 9/19] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:42:34.796446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fe1fa-67f1-4c52-ab40-ed7f884cadf2 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:34.881157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfd730-9de3-4848-8636-3310732d2a63 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:34.895187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fe1fa-67f1-4c52-ab40-ed7f884cadf2 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:34.914037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c909187-ce51-4d9d-8efb-bccb49f579fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:34.914708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c909187-ce51-4d9d-8efb-bccb49f579fa None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:34.914982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c909187-ce51-4d9d-8efb-bccb49f579fa None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:34.915282 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c909187-ce51-4d9d-8efb-bccb49f579fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:34.916079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c909187-ce51-4d9d-8efb-bccb49f579fa None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.domain.id=default, user.id=03485317eebc406bacc978bde43ff42a) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:34.916387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c909187-ce51-4d9d-8efb-bccb49f579fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:34.917901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c909187-ce51-4d9d-8efb-bccb49f579fa None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:34.924773 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 11/20] 10.222.0.35 () {56 vars in 1322 bytes} [Wed May 4 18:42:34 2022] GET /identity/v3/role_assignments?user.id=03485317eebc406bacc978bde43ff42a&scope.domain.id=default&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:34.927672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e567cd4-0575-4910-b237-9a5f8df60c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:34.928349 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e567cd4-0575-4910-b237-9a5f8df60c34 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:34.928631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e567cd4-0575-4910-b237-9a5f8df60c34 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:34.928906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e567cd4-0575-4910-b237-9a5f8df60c34 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:34.929679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e567cd4-0575-4910-b237-9a5f8df60c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:34.929987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e567cd4-0575-4910-b237-9a5f8df60c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:34.931402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e567cd4-0575-4910-b237-9a5f8df60c34 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:34.951353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 10/21] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:38.206966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571912a5-9914-4388-a686-b951394175b5 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.207490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571912a5-9914-4388-a686-b951394175b5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.207490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571912a5-9914-4388-a686-b951394175b5 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.208993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 12/22] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:38.220805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e273-d5e0-4b3e-890c-0ef25e28f0fb None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.221765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e273-d5e0-4b3e-890c-0ef25e28f0fb None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.222240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e273-d5e0-4b3e-890c-0ef25e28f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.246311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-1374e273-d5e0-4b3e-890c-0ef25e28f0fb None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:38.247886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1374e273-d5e0-4b3e-890c-0ef25e28f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:38.335337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 11/23] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:38.370613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571912a5-9914-4388-a686-b951394175b5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:38.376289 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587a3c1-0feb-4683-bf8c-2a223ef3f88a None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.376811 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587a3c1-0feb-4683-bf8c-2a223ef3f88a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.377300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587a3c1-0feb-4683-bf8c-2a223ef3f88a None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.379185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 12/24] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:38.384297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b125d5-ebad-40ba-836b-d18f04d7a418 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.384864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b125d5-ebad-40ba-836b-d18f04d7a418 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.385376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b125d5-ebad-40ba-836b-d18f04d7a418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.410408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-22b125d5-ebad-40ba-836b-d18f04d7a418 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:38.412042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-22b125d5-ebad-40ba-836b-d18f04d7a418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:38.527927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571912a5-9914-4388-a686-b951394175b5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:38.563865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665d57a-e736-4c79-ac75-ef4ffff535bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:38.565038 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d57a-e736-4c79-ac75-ef4ffff535bd None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.565575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d57a-e736-4c79-ac75-ef4ffff535bd None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.566033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d57a-e736-4c79-ac75-ef4ffff535bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.578630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665d57a-e736-4c79-ac75-ef4ffff535bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-6665d57a-e736-4c79-ac75-ef4ffff535bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:38.586740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:38.587684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:38.588905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:42:38.591228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 13/25] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:42:38.592591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14bb3-67a6-422a-b675-70593fd8714f None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.592878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14bb3-67a6-422a-b675-70593fd8714f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.593144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14bb3-67a6-422a-b675-70593fd8714f None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.593586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 13/26] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:42:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:38.598199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 14/27] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:38.599863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665d57a-e736-4c79-ac75-ef4ffff535bd None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:38.605461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59979b92-4f42-4ed5-8193-89358ede388d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.605754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59979b92-4f42-4ed5-8193-89358ede388d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.606037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59979b92-4f42-4ed5-8193-89358ede388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.642352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-59979b92-4f42-4ed5-8193-89358ede388d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:38.643551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-59979b92-4f42-4ed5-8193-89358ede388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:38.705098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665d57a-e736-4c79-ac75-ef4ffff535bd None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:38.739269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789587-ad62-485d-9abe-4458cbc3bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:38.740321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789587-ad62-485d-9abe-4458cbc3bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.740799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789587-ad62-485d-9abe-4458cbc3bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.741269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789587-ad62-485d-9abe-4458cbc3bbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.742267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789587-ad62-485d-9abe-4458cbc3bbd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:38.742757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789587-ad62-485d-9abe-4458cbc3bbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:38.744335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789587-ad62-485d-9abe-4458cbc3bbd1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:38.750726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 15/28] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:42:38.751573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59979b92-4f42-4ed5-8193-89358ede388d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:38.753615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 14/29] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:38.762715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789587-ad62-485d-9abe-4458cbc3bbd1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:38.882311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59979b92-4f42-4ed5-8193-89358ede388d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:38.896640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789587-ad62-485d-9abe-4458cbc3bbd1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:38.931420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51073b4-961e-4992-8061-84019b9be88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:38.932621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51073b4-961e-4992-8061-84019b9be88f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.932874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d13481-7a90-4ee1-97d8-53bd1ed12492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:38.932997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51073b4-961e-4992-8061-84019b9be88f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.933424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51073b4-961e-4992-8061-84019b9be88f None admin] PATH_INFO: `/v3/users/03485317eebc406bacc978bde43ff42a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.934222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13481-7a90-4ee1-97d8-53bd1ed12492 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.934590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13481-7a90-4ee1-97d8-53bd1ed12492 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.934953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13481-7a90-4ee1-97d8-53bd1ed12492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.935825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51073b4-961e-4992-8061-84019b9be88f None admin] RBAC: Authorizing `identity:get_user(user_id=03485317eebc406bacc978bde43ff42a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:38.938125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51073b4-961e-4992-8061-84019b9be88f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:38.939922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 15/30] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:38 2022] GET /identity/v3/users/03485317eebc406bacc978bde43ff42a => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:38.940800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51073b4-961e-4992-8061-84019b9be88f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:38.947248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d13481-7a90-4ee1-97d8-53bd1ed12492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:38.948842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d13481-7a90-4ee1-97d8-53bd1ed12492 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-81d13481-7a90-4ee1-97d8-53bd1ed12492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:42:38.969472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:38.970372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:38.971214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:42:38.971214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:42:38.971214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:42:38.971214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:42:38.971214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 16/31] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:38.976917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951065-930c-4dd5-ac12-3536032d0095 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:38.976917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951065-930c-4dd5-ac12-3536032d0095 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:38.976917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951065-930c-4dd5-ac12-3536032d0095 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:38.976917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 17/32] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:38.976917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28951065-930c-4dd5-ac12-3536032d0095 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:39.056552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51073b4-961e-4992-8061-84019b9be88f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:39.089715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068fad7-1771-4f5b-8b3b-91b0d841492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:39.090775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068fad7-1771-4f5b-8b3b-91b0d841492e None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.091233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068fad7-1771-4f5b-8b3b-91b0d841492e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.091732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068fad7-1771-4f5b-8b3b-91b0d841492e None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.092732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068fad7-1771-4f5b-8b3b-91b0d841492e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:39.094422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068fad7-1771-4f5b-8b3b-91b0d841492e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:39.096932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28951065-930c-4dd5-ac12-3536032d0095 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:39.132338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d510-33a7-4c86-bbde-778159123832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:39.133159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d510-33a7-4c86-bbde-778159123832 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.133481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d510-33a7-4c86-bbde-778159123832 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.133759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d510-33a7-4c86-bbde-778159123832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.135174 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713d510-33a7-4c86-bbde-778159123832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:39.136615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713d510-33a7-4c86-bbde-778159123832 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:39.138598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 18/33] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:39.139419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d510-33a7-4c86-bbde-778159123832 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:39.236713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d510-33a7-4c86-bbde-778159123832 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:39.238554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 16/34] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 4 18:42:38 2022] POST /identity/v3/roles => generated 219 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:42:39.240731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c5fa8-6d85-429b-93aa-8068f01ba0f9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.241275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c5fa8-6d85-429b-93aa-8068f01ba0f9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.241815 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c5fa8-6d85-429b-93aa-8068f01ba0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.261545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-220c5fa8-6d85-429b-93aa-8068f01ba0f9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:39.263469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-220c5fa8-6d85-429b-93aa-8068f01ba0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:39.272108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647022bf-c0e3-495a-8be8-5b592d93e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:39.272789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647022bf-c0e3-495a-8be8-5b592d93e735 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.273066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647022bf-c0e3-495a-8be8-5b592d93e735 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.273365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647022bf-c0e3-495a-8be8-5b592d93e735 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.274121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647022bf-c0e3-495a-8be8-5b592d93e735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:39.274427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647022bf-c0e3-495a-8be8-5b592d93e735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:39.276161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647022bf-c0e3-495a-8be8-5b592d93e735 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:39.288637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 19/35] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:39.289370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647022bf-c0e3-495a-8be8-5b592d93e735 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:39.339173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 17/36] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:39.340321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c5fa8-6d85-429b-93aa-8068f01ba0f9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:39.390130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647022bf-c0e3-495a-8be8-5b592d93e735 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:39.424579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba614-27a1-4f7d-9a93-43718fd467ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:39.425491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba614-27a1-4f7d-9a93-43718fd467ab None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.425771 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba614-27a1-4f7d-9a93-43718fd467ab None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.426052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba614-27a1-4f7d-9a93-43718fd467ab None admin] PATH_INFO: `/v3/domains/default/users/03485317eebc406bacc978bde43ff42a/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.428397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba614-27a1-4f7d-9a93-43718fd467ab None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=03485317eebc406bacc978bde43ff42a, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:39.429906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba614-27a1-4f7d-9a93-43718fd467ab None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:39.464024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c5fa8-6d85-429b-93aa-8068f01ba0f9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:39.501811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd0bae-1790-4745-8d1e-eb74392b7182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:39.503015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0bae-1790-4745-8d1e-eb74392b7182 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.503616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0bae-1790-4745-8d1e-eb74392b7182 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.504106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0bae-1790-4745-8d1e-eb74392b7182 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.505173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd0bae-1790-4745-8d1e-eb74392b7182 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:39.507364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd0bae-1790-4745-8d1e-eb74392b7182 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:39.540491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 18/37] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:42:39 2022] POST /identity/v3/projects => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:42:39.541867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd0bae-1790-4745-8d1e-eb74392b7182 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:39.562172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 20/38] 10.222.0.35 () {58 vars in 1361 bytes} [Wed May 4 18:42:39 2022] PUT /identity/v3/domains/default/users/03485317eebc406bacc978bde43ff42a/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:42:39.671413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd0bae-1790-4745-8d1e-eb74392b7182 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:39.711165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbeee9-9223-4e3a-971c-0a9f05b77a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:39.712292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbeee9-9223-4e3a-971c-0a9f05b77a50 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.712783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbeee9-9223-4e3a-971c-0a9f05b77a50 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.713267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbeee9-9223-4e3a-971c-0a9f05b77a50 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.714310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbeee9-9223-4e3a-971c-0a9f05b77a50 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:39.715998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbeee9-9223-4e3a-971c-0a9f05b77a50 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:39.735319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 19/39] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 4 18:42:39 2022] POST /identity/v3/roles => generated 225 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:42:39.866256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7350f0a-58ee-40eb-8172-1ecde2cc5f02 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.866582 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7350f0a-58ee-40eb-8172-1ecde2cc5f02 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.866819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7350f0a-58ee-40eb-8172-1ecde2cc5f02 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.871579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 21/40] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:39.877769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c9c06-c8c0-4a66-a123-06295f88b506 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.878396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c9c06-c8c0-4a66-a123-06295f88b506 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.878864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c9c06-c8c0-4a66-a123-06295f88b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.898724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d59c9c06-c8c0-4a66-a123-06295f88b506 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:39.900372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d59c9c06-c8c0-4a66-a123-06295f88b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:39.908609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab252bb-f6b1-4a1d-a450-bb213a034eed None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.909256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab252bb-f6b1-4a1d-a450-bb213a034eed None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.909750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab252bb-f6b1-4a1d-a450-bb213a034eed None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.912214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 22/41] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:39.918131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ce346-673c-4236-9445-a6bd7edee2e6 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:39.918711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ce346-673c-4236-9445-a6bd7edee2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:39.919236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ce346-673c-4236-9445-a6bd7edee2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:39.946433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-213ce346-673c-4236-9445-a6bd7edee2e6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:39.948341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-213ce346-673c-4236-9445-a6bd7edee2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:39.982294 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 20/42] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:40.005089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c9c06-c8c0-4a66-a123-06295f88b506 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:40.027654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 23/43] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:42:40.049950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ce346-673c-4236-9445-a6bd7edee2e6 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:40.108110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c9c06-c8c0-4a66-a123-06295f88b506 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:40.141201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477c501-a24b-4a55-94a6-6244c5227e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:40.142184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477c501-a24b-4a55-94a6-6244c5227e6d None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:40.142461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477c501-a24b-4a55-94a6-6244c5227e6d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:40.142744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477c501-a24b-4a55-94a6-6244c5227e6d None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:40.143504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477c501-a24b-4a55-94a6-6244c5227e6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:40.144887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477c501-a24b-4a55-94a6-6244c5227e6d None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:40.145605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ce346-673c-4236-9445-a6bd7edee2e6 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:40.159459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 21/44] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 4 18:42:40 2022] POST /identity/v3/roles => generated 223 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:42:40.183048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd387-98e6-4e7f-b3ad-5d878e8db7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:40.183868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd387-98e6-4e7f-b3ad-5d878e8db7bd None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:40.184148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd387-98e6-4e7f-b3ad-5d878e8db7bd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:40.184419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd387-98e6-4e7f-b3ad-5d878e8db7bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:40.185700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dd387-98e6-4e7f-b3ad-5d878e8db7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:40.187329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dd387-98e6-4e7f-b3ad-5d878e8db7bd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:40.193319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 24/45] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:40.195448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477c501-a24b-4a55-94a6-6244c5227e6d None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:40.299793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477c501-a24b-4a55-94a6-6244c5227e6d None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:40.335159 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18902d-34e4-4a6a-9fd0-86b0edad1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:40.335837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18902d-34e4-4a6a-9fd0-86b0edad1dd5 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:40.336117 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18902d-34e4-4a6a-9fd0-86b0edad1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:40.336397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18902d-34e4-4a6a-9fd0-86b0edad1dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:40.337100 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18902d-34e4-4a6a-9fd0-86b0edad1dd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:40.338591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18902d-34e4-4a6a-9fd0-86b0edad1dd5 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:40.366339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 22/46] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:42:40 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:42:41.946635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ec6c8-f25b-448f-a205-6c1b0f9c20b8 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:41.947176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ec6c8-f25b-448f-a205-6c1b0f9c20b8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:41.947176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ec6c8-f25b-448f-a205-6c1b0f9c20b8 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:41.948537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 25/47] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:41.953763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b254d-9c3c-4d36-a254-b3ce3ecb64f8 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:41.954174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b254d-9c3c-4d36-a254-b3ce3ecb64f8 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:41.954389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b254d-9c3c-4d36-a254-b3ce3ecb64f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:41.971352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d65b254d-9c3c-4d36-a254-b3ce3ecb64f8 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:41.972522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d65b254d-9c3c-4d36-a254-b3ce3ecb64f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:42.038269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 23/48] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:42.061643 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ec6c8-f25b-448f-a205-6c1b0f9c20b8 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:42.160328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ec6c8-f25b-448f-a205-6c1b0f9c20b8 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:42.194524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a698929-e60a-42fb-bc8b-517f718d024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:42.195318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a698929-e60a-42fb-bc8b-517f718d024b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:42.195600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a698929-e60a-42fb-bc8b-517f718d024b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:42.195870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a698929-e60a-42fb-bc8b-517f718d024b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:42.207477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a698929-e60a-42fb-bc8b-517f718d024b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-6a698929-e60a-42fb-bc8b-517f718d024b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:42.216078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:42.217123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:42:42.217979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 26/49] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:42:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:42.223423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b254d-9c3c-4d36-a254-b3ce3ecb64f8 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:42.328249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b254d-9c3c-4d36-a254-b3ce3ecb64f8 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:42.362309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03980c3-426a-420b-aef5-62733031a6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:42.362973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03980c3-426a-420b-aef5-62733031a6db None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:42.363253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03980c3-426a-420b-aef5-62733031a6db None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:42.363523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03980c3-426a-420b-aef5-62733031a6db None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:42.364280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03980c3-426a-420b-aef5-62733031a6db None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:42.364587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03980c3-426a-420b-aef5-62733031a6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:42.365998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03980c3-426a-420b-aef5-62733031a6db None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:42.374342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 24/50] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:42.380412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a698929-e60a-42fb-bc8b-517f718d024b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:42.488081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a698929-e60a-42fb-bc8b-517f718d024b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:42.521795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec7458-6603-45dd-8173-ed3576aa9bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:42.522684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec7458-6603-45dd-8173-ed3576aa9bab None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:42.522966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec7458-6603-45dd-8173-ed3576aa9bab None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:42.523242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec7458-6603-45dd-8173-ed3576aa9bab None admin] PATH_INFO: `/v3/users/03485317eebc406bacc978bde43ff42a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:42.524445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec7458-6603-45dd-8173-ed3576aa9bab None admin] RBAC: Authorizing `identity:get_user(user_id=03485317eebc406bacc978bde43ff42a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:42.525928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec7458-6603-45dd-8173-ed3576aa9bab None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:42.527583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 27/51] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:42 2022] GET /identity/v3/users/03485317eebc406bacc978bde43ff42a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:42.533072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03980c3-426a-420b-aef5-62733031a6db None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:42.573616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d162b2-3d8e-4f68-86b4-642927651154 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:42.573853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d162b2-3d8e-4f68-86b4-642927651154 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:42.574172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d162b2-3d8e-4f68-86b4-642927651154 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:42.575540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 28/52] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:42:42.581174 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed3be-e19e-4c32-88a9-34a93a4ecbc0 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:42.581489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed3be-e19e-4c32-88a9-34a93a4ecbc0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:42.581769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed3be-e19e-4c32-88a9-34a93a4ecbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:42.601317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-16aed3be-e19e-4c32-88a9-34a93a4ecbc0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:42.602545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-16aed3be-e19e-4c32-88a9-34a93a4ecbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:42.637309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03980c3-426a-420b-aef5-62733031a6db None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:42.668184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 29/53] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:42.669358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28580dab-8b13-48fd-bd23-968f12e463d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:42.670154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28580dab-8b13-48fd-bd23-968f12e463d9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:42.670431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28580dab-8b13-48fd-bd23-968f12e463d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:42.670706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28580dab-8b13-48fd-bd23-968f12e463d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:42.671904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28580dab-8b13-48fd-bd23-968f12e463d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:42.673380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28580dab-8b13-48fd-bd23-968f12e463d9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:42.674961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 25/54] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:42.680793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aed3be-e19e-4c32-88a9-34a93a4ecbc0 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:42.690732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28580dab-8b13-48fd-bd23-968f12e463d9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:42.776183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aed3be-e19e-4c32-88a9-34a93a4ecbc0 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:42.790766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28580dab-8b13-48fd-bd23-968f12e463d9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:42.807588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b205ad9-714f-4001-98aa-5003f4332618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:42.808246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b205ad9-714f-4001-98aa-5003f4332618 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:42.808527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b205ad9-714f-4001-98aa-5003f4332618 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:42.808803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b205ad9-714f-4001-98aa-5003f4332618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:42.809664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b205ad9-714f-4001-98aa-5003f4332618 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.domain.id=default, user.id=03485317eebc406bacc978bde43ff42a) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:42.809969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b205ad9-714f-4001-98aa-5003f4332618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:42.811429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b205ad9-714f-4001-98aa-5003f4332618 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:42.819314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 30/55] 10.222.0.35 () {56 vars in 1322 bytes} [Wed May 4 18:42:42 2022] GET /identity/v3/role_assignments?user.id=03485317eebc406bacc978bde43ff42a&scope.domain.id=default&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:42.825344 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9099261-f889-4f87-a8ed-0b833eb23dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:42.826177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9099261-f889-4f87-a8ed-0b833eb23dec None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:42.826460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9099261-f889-4f87-a8ed-0b833eb23dec None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:42.826735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9099261-f889-4f87-a8ed-0b833eb23dec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:42.827974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9099261-f889-4f87-a8ed-0b833eb23dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:42.829480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9099261-f889-4f87-a8ed-0b833eb23dec None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:42.831352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 26/56] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:42.837250 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b205ad9-714f-4001-98aa-5003f4332618 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:42.944406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b205ad9-714f-4001-98aa-5003f4332618 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:42.979364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535cfcd-e315-4cac-a06d-905c2af97144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:42.980063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535cfcd-e315-4cac-a06d-905c2af97144 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:42.980307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535cfcd-e315-4cac-a06d-905c2af97144 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:42.980567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535cfcd-e315-4cac-a06d-905c2af97144 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:42.981320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535cfcd-e315-4cac-a06d-905c2af97144 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:42.982786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535cfcd-e315-4cac-a06d-905c2af97144 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:43.013533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 31/57] 10.222.0.35 () {60 vars in 1140 bytes} [Wed May 4 18:42:42 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:42:45.236126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad82e1-0d07-4b08-a3b1-2857aae9d338 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:45.236952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad82e1-0d07-4b08-a3b1-2857aae9d338 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:45.236952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad82e1-0d07-4b08-a3b1-2857aae9d338 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:45.239152 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 27/58] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:45.245314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c81a8-8918-42c3-9a98-4b2dc5d4f4ad None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:45.245982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c81a8-8918-42c3-9a98-4b2dc5d4f4ad None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:45.246255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c81a8-8918-42c3-9a98-4b2dc5d4f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:45.267277 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-342c81a8-8918-42c3-9a98-4b2dc5d4f4ad None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:45.268468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-342c81a8-8918-42c3-9a98-4b2dc5d4f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:45.332911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 32/59] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:45.357515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad82e1-0d07-4b08-a3b1-2857aae9d338 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:45.477632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad82e1-0d07-4b08-a3b1-2857aae9d338 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:45.513564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f1a4b-f28b-46ab-9d29-215942f904f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:45.514284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f1a4b-f28b-46ab-9d29-215942f904f9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:45.514568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f1a4b-f28b-46ab-9d29-215942f904f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:45.514831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f1a4b-f28b-46ab-9d29-215942f904f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:45.516089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f1a4b-f28b-46ab-9d29-215942f904f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:45.517546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f1a4b-f28b-46ab-9d29-215942f904f9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:45.519132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 28/60] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:45.527980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c81a8-8918-42c3-9a98-4b2dc5d4f4ad None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:45.629739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c81a8-8918-42c3-9a98-4b2dc5d4f4ad None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:45.662777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953db9d9-6a68-4dc0-9eab-60cf54ff9fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:45.663432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953db9d9-6a68-4dc0-9eab-60cf54ff9fc8 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:45.663712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953db9d9-6a68-4dc0-9eab-60cf54ff9fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:45.663987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953db9d9-6a68-4dc0-9eab-60cf54ff9fc8 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:45.664684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953db9d9-6a68-4dc0-9eab-60cf54ff9fc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:45.666157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953db9d9-6a68-4dc0-9eab-60cf54ff9fc8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:45.697833 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 33/61] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:42:45 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:42:49.051305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96b499-552e-42d2-90d2-392472121282 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.052382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96b499-552e-42d2-90d2-392472121282 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.052874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96b499-552e-42d2-90d2-392472121282 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.054479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 29/62] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:49.059775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d9c1d-a5c2-47c7-9fd5-a2aafba59a51 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.060593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d9c1d-a5c2-47c7-9fd5-a2aafba59a51 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.061060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d9c1d-a5c2-47c7-9fd5-a2aafba59a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.085570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-088d9c1d-a5c2-47c7-9fd5-a2aafba59a51 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:49.087095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-088d9c1d-a5c2-47c7-9fd5-a2aafba59a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:49.117917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3cb58-10a9-49b4-b7e0-48788414f182 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.118530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3cb58-10a9-49b4-b7e0-48788414f182 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.119002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3cb58-10a9-49b4-b7e0-48788414f182 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.120583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 30/63] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:42:49.126173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfadba1-0de8-4cf4-9768-c5d84490edbd None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.126699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfadba1-0de8-4cf4-9768-c5d84490edbd None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.127190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfadba1-0de8-4cf4-9768-c5d84490edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.144601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-5dfadba1-0de8-4cf4-9768-c5d84490edbd None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:49.146206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5dfadba1-0de8-4cf4-9768-c5d84490edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:49.175836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 34/64] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:49.198811 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d9c1d-a5c2-47c7-9fd5-a2aafba59a51 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:49.247682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 31/65] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:42:49.295705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfadba1-0de8-4cf4-9768-c5d84490edbd None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:49.301920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d9c1d-a5c2-47c7-9fd5-a2aafba59a51 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:49.345004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4814-e095-46a5-9d70-22021946b0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:49.346158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4814-e095-46a5-9d70-22021946b0ab None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.346614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4814-e095-46a5-9d70-22021946b0ab None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.347071 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4814-e095-46a5-9d70-22021946b0ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.363520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4814-e095-46a5-9d70-22021946b0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-5d7b4814-e095-46a5-9d70-22021946b0ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:49.372165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:49.373026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:49.373896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:42:49.389400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 35/66] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:42:49.393119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4814-e095-46a5-9d70-22021946b0ab None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:49.485781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfadba1-0de8-4cf4-9768-c5d84490edbd None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:49.518658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda86786-5401-4534-bfe6-7cc17210c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:49.519470 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86786-5401-4534-bfe6-7cc17210c69f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.519751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86786-5401-4534-bfe6-7cc17210c69f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.520027 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86786-5401-4534-bfe6-7cc17210c69f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.528458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4814-e095-46a5-9d70-22021946b0ab None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:49.529998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda86786-5401-4534-bfe6-7cc17210c69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-dda86786-5401-4534-bfe6-7cc17210c69f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:49.537673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:49.538532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:42:49.539283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 32/67] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:42:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:42:49.540467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95598a-cb4b-4680-bde5-203407e58df5 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.540551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95598a-cb4b-4680-bde5-203407e58df5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.540978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95598a-cb4b-4680-bde5-203407e58df5 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.542018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 33/68] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:49.543485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0cc8-0b23-4001-97f9-78a694bfffdc None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.543940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0cc8-0b23-4001-97f9-78a694bfffdc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.544388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0cc8-0b23-4001-97f9-78a694bfffdc None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.549685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 34/69] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:49.549685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0cc8-0b23-4001-97f9-78a694bfffdc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:49.565657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db714b-fb49-4547-afd5-66fa6ad21345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:49.566591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db714b-fb49-4547-afd5-66fa6ad21345 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.566882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db714b-fb49-4547-afd5-66fa6ad21345 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.567155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db714b-fb49-4547-afd5-66fa6ad21345 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.567946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db714b-fb49-4547-afd5-66fa6ad21345 None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:49.568258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db714b-fb49-4547-afd5-66fa6ad21345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:49.569707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db714b-fb49-4547-afd5-66fa6ad21345 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:49.585904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 36/70] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:42:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:49.585904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bebce-40f9-476b-a8d0-fa1f69111df1 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.585904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bebce-40f9-476b-a8d0-fa1f69111df1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.585904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bebce-40f9-476b-a8d0-fa1f69111df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.600330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e59bebce-40f9-476b-a8d0-fa1f69111df1 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:49.601558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e59bebce-40f9-476b-a8d0-fa1f69111df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:49.652913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0cc8-0b23-4001-97f9-78a694bfffdc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:49.667356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 37/71] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:49.669059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e752d-1a62-4b77-ba7a-dfb16f8e98e3 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.669384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e752d-1a62-4b77-ba7a-dfb16f8e98e3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.669663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e752d-1a62-4b77-ba7a-dfb16f8e98e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.687108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b40e752d-1a62-4b77-ba7a-dfb16f8e98e3 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:49.688290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b40e752d-1a62-4b77-ba7a-dfb16f8e98e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:49.700347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a03405-489e-4d4f-a33c-0c69331d7aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:49.701032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a03405-489e-4d4f-a33c-0c69331d7aea None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.701342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a03405-489e-4d4f-a33c-0c69331d7aea None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.701655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a03405-489e-4d4f-a33c-0c69331d7aea None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.702397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a03405-489e-4d4f-a33c-0c69331d7aea None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:49.702721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a03405-489e-4d4f-a33c-0c69331d7aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:49.704107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a03405-489e-4d4f-a33c-0c69331d7aea None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:49.713918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 35/72] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:49.715498 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a03405-489e-4d4f-a33c-0c69331d7aea None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:49.773309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 38/73] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:49.773309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e752d-1a62-4b77-ba7a-dfb16f8e98e3 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:49.812063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a03405-489e-4d4f-a33c-0c69331d7aea None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:49.845118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53453d1-ccbe-4334-a520-b5c4c6bd29a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:49.845945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53453d1-ccbe-4334-a520-b5c4c6bd29a9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.846233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53453d1-ccbe-4334-a520-b5c4c6bd29a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.846508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53453d1-ccbe-4334-a520-b5c4c6bd29a9 None admin] PATH_INFO: `/v3/users/e49e7be519494a34b3624efb00d6101f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.859211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53453d1-ccbe-4334-a520-b5c4c6bd29a9 None admin] RBAC: Authorizing `identity:get_user(user_id=e49e7be519494a34b3624efb00d6101f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:49.860705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53453d1-ccbe-4334-a520-b5c4c6bd29a9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:49.862386 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 36/74] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:49 2022] GET /identity/v3/users/e49e7be519494a34b3624efb00d6101f => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:49.867318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53453d1-ccbe-4334-a520-b5c4c6bd29a9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:49.867405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e752d-1a62-4b77-ba7a-dfb16f8e98e3 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:49.898401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc4868-7a96-4171-9a91-de30375640c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:49.899240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4868-7a96-4171-9a91-de30375640c7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.899521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4868-7a96-4171-9a91-de30375640c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.899796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4868-7a96-4171-9a91-de30375640c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.909658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc4868-7a96-4171-9a91-de30375640c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-fbdc4868-7a96-4171-9a91-de30375640c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:49.918321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:49.919220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:42:49.919989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 39/75] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:42:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:49.920609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc4868-7a96-4171-9a91-de30375640c7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:49.963348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53453d1-ccbe-4334-a520-b5c4c6bd29a9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:49.996215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392284d-3531-4e29-a3fe-8e5cefa1268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:49.997088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392284d-3531-4e29-a3fe-8e5cefa1268f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:49.997398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392284d-3531-4e29-a3fe-8e5cefa1268f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:49.997674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392284d-3531-4e29-a3fe-8e5cefa1268f None admin] PATH_INFO: `/v3/users/03485317eebc406bacc978bde43ff42a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:49.998921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392284d-3531-4e29-a3fe-8e5cefa1268f None admin] RBAC: Authorizing `identity:get_user(user_id=03485317eebc406bacc978bde43ff42a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.000676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392284d-3531-4e29-a3fe-8e5cefa1268f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.002310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 37/76] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:49 2022] GET /identity/v3/users/03485317eebc406bacc978bde43ff42a => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:50.003466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fdc45-ec81-42cb-9e4d-b69316eec91e None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.003751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fdc45-ec81-42cb-9e4d-b69316eec91e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.004029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fdc45-ec81-42cb-9e4d-b69316eec91e None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.005264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 38/77] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:50.005995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fdc45-ec81-42cb-9e4d-b69316eec91e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.023215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc4868-7a96-4171-9a91-de30375640c7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cbea3-9d26-4739-9e92-aa6353c9aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.056028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbea3-9d26-4739-9e92-aa6353c9aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbea3-9d26-4739-9e92-aa6353c9aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.056586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbea3-9d26-4739-9e92-aa6353c9aeb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.066403 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cbea3-9d26-4739-9e92-aa6353c9aeb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-903cbea3-9d26-4739-9e92-aa6353c9aeb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:50.074124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:50.074968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:42:50.075723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 40/78] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:50.076434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cbea3-9d26-4739-9e92-aa6353c9aeb4 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.105411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fdc45-ec81-42cb-9e4d-b69316eec91e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.136693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97cfb9-4230-4306-b7be-8d25c33cf4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.137379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97cfb9-4230-4306-b7be-8d25c33cf4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.137660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97cfb9-4230-4306-b7be-8d25c33cf4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.137937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97cfb9-4230-4306-b7be-8d25c33cf4a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.169836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cbea3-9d26-4739-9e92-aa6353c9aeb4 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.202756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b615c6-1a92-4482-855b-ac34dcae8e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.203412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b615c6-1a92-4482-855b-ac34dcae8e6b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.203544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97cfb9-4230-4306-b7be-8d25c33cf4a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.203664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b615c6-1a92-4482-855b-ac34dcae8e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.203954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b615c6-1a92-4482-855b-ac34dcae8e6b None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.204695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b615c6-1a92-4482-855b-ac34dcae8e6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:50.204993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97cfb9-4230-4306-b7be-8d25c33cf4a8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.205094 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b615c6-1a92-4482-855b-ac34dcae8e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.206411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b615c6-1a92-4482-855b-ac34dcae8e6b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.214277 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 41/79] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:50.214863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b615c6-1a92-4482-855b-ac34dcae8e6b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.305876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 39/80] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:42:50.307178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ac3cb-285a-4bc1-ac91-454e9d32a70b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.307469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ac3cb-285a-4bc1-ac91-454e9d32a70b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.307744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ac3cb-285a-4bc1-ac91-454e9d32a70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.308631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b615c6-1a92-4482-855b-ac34dcae8e6b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.324069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-1b5ac3cb-285a-4bc1-ac91-454e9d32a70b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:50.325240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1b5ac3cb-285a-4bc1-ac91-454e9d32a70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:50.339855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239079f-d25b-4616-bfc2-6034c1c13095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.340508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239079f-d25b-4616-bfc2-6034c1c13095 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.340793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239079f-d25b-4616-bfc2-6034c1c13095 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.341072 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239079f-d25b-4616-bfc2-6034c1c13095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.389448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 40/81] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:50.390099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ac3cb-285a-4bc1-ac91-454e9d32a70b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.408364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239079f-d25b-4616-bfc2-6034c1c13095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.409851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239079f-d25b-4616-bfc2-6034c1c13095 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.499345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ac3cb-285a-4bc1-ac91-454e9d32a70b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.507006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 42/82] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:42:50.507926 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239079f-d25b-4616-bfc2-6034c1c13095 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.533144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acc6f0-72b2-4433-88fe-e5f0b2c767fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.533866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acc6f0-72b2-4433-88fe-e5f0b2c767fe None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.534138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acc6f0-72b2-4433-88fe-e5f0b2c767fe None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.534407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acc6f0-72b2-4433-88fe-e5f0b2c767fe None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.535152 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acc6f0-72b2-4433-88fe-e5f0b2c767fe None admin] RBAC: Adding query filter params (name=member) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:50.535452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acc6f0-72b2-4433-88fe-e5f0b2c767fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.536886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acc6f0-72b2-4433-88fe-e5f0b2c767fe None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.544742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 41/83] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:50.549411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acc6f0-72b2-4433-88fe-e5f0b2c767fe None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.600079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239079f-d25b-4616-bfc2-6034c1c13095 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.631695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ef02-e1e7-48fd-9fc4-301ac69a0dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.632555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ef02-e1e7-48fd-9fc4-301ac69a0dfb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.632808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ef02-e1e7-48fd-9fc4-301ac69a0dfb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.633079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ef02-e1e7-48fd-9fc4-301ac69a0dfb None admin] PATH_INFO: `/v3/users/e49e7be519494a34b3624efb00d6101f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.634336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77ef02-e1e7-48fd-9fc4-301ac69a0dfb None admin] RBAC: Authorizing `identity:get_user(user_id=e49e7be519494a34b3624efb00d6101f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.635777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77ef02-e1e7-48fd-9fc4-301ac69a0dfb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.637423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 43/84] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/users/e49e7be519494a34b3624efb00d6101f => generated 275 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:50.638173 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ef02-e1e7-48fd-9fc4-301ac69a0dfb None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.644572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acc6f0-72b2-4433-88fe-e5f0b2c767fe None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.676088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0266f-4837-48c4-bd09-49ff76058231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.676948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0266f-4837-48c4-bd09-49ff76058231 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.677262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0266f-4837-48c4-bd09-49ff76058231 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.677573 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0266f-4837-48c4-bd09-49ff76058231 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.678756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0266f-4837-48c4-bd09-49ff76058231 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.680167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0266f-4837-48c4-bd09-49ff76058231 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.682959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 42/85] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:50.682959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0266f-4837-48c4-bd09-49ff76058231 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.737842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ef02-e1e7-48fd-9fc4-301ac69a0dfb None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.770215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5993f-d727-437d-ba36-13ca87f9a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.771033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5993f-d727-437d-ba36-13ca87f9a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.771320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5993f-d727-437d-ba36-13ca87f9a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.771604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5993f-d727-437d-ba36-13ca87f9a1d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.772760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5993f-d727-437d-ba36-13ca87f9a1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.773253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0266f-4837-48c4-bd09-49ff76058231 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.774263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5993f-d727-437d-ba36-13ca87f9a1d5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.776921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 44/86] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:50.776921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5993f-d727-437d-ba36-13ca87f9a1d5 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.805904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6088457-5b3c-4a4f-a482-9a6bca0d7ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.806770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6088457-5b3c-4a4f-a482-9a6bca0d7ba1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.807101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6088457-5b3c-4a4f-a482-9a6bca0d7ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.807376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6088457-5b3c-4a4f-a482-9a6bca0d7ba1 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.808556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6088457-5b3c-4a4f-a482-9a6bca0d7ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.810059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6088457-5b3c-4a4f-a482-9a6bca0d7ba1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.811740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 43/87] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:50.812489 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6088457-5b3c-4a4f-a482-9a6bca0d7ba1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.872125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5993f-d727-437d-ba36-13ca87f9a1d5 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.905186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba29b29-bffd-4068-ab53-62e5b7a2a8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.905368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6088457-5b3c-4a4f-a482-9a6bca0d7ba1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:50.906010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba29b29-bffd-4068-ab53-62e5b7a2a8c6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.906289 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba29b29-bffd-4068-ab53-62e5b7a2a8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.906556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba29b29-bffd-4068-ab53-62e5b7a2a8c6 None admin] PATH_INFO: `/v3/users/e49e7be519494a34b3624efb00d6101f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:50.907742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba29b29-bffd-4068-ab53-62e5b7a2a8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=e49e7be519494a34b3624efb00d6101f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:50.909176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba29b29-bffd-4068-ab53-62e5b7a2a8c6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:50.910811 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 45/88] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/users/e49e7be519494a34b3624efb00d6101f => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:50.915421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba29b29-bffd-4068-ab53-62e5b7a2a8c6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:50.937247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88624b-7a81-4c9b-aa19-515827c6a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:50.937921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88624b-7a81-4c9b-aa19-515827c6a678 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:50.938199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88624b-7a81-4c9b-aa19-515827c6a678 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:50.938472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88624b-7a81-4c9b-aa19-515827c6a678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:51.003866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88624b-7a81-4c9b-aa19-515827c6a678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:51.005327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88624b-7a81-4c9b-aa19-515827c6a678 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:51.009171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba29b29-bffd-4068-ab53-62e5b7a2a8c6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:51.042503 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18110903-1e08-4626-8325-e6ade890b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:51.043139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110903-1e08-4626-8325-e6ade890b276 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:51.043479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110903-1e08-4626-8325-e6ade890b276 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:51.043752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110903-1e08-4626-8325-e6ade890b276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:51.044575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18110903-1e08-4626-8325-e6ade890b276 None admin] RBAC: Adding query filter params (role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a, user.id=e49e7be519494a34b3624efb00d6101f) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:51.044882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18110903-1e08-4626-8325-e6ade890b276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:51.046328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18110903-1e08-4626-8325-e6ade890b276 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:51.051909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 46/89] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/role_assignments?user.id=e49e7be519494a34b3624efb00d6101f&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=fda329dea4e7408c9791a6554d482329 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:51.053089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18110903-1e08-4626-8325-e6ade890b276 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:51.106739 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 44/90] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:42:51.107708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88624b-7a81-4c9b-aa19-515827c6a678 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:51.157688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18110903-1e08-4626-8325-e6ade890b276 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:51.192565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18253f8a-eda9-4db6-a922-542554112b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:51.193718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18253f8a-eda9-4db6-a922-542554112b96 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:51.194048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18253f8a-eda9-4db6-a922-542554112b96 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:51.194367 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18253f8a-eda9-4db6-a922-542554112b96 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:51.195092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18253f8a-eda9-4db6-a922-542554112b96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:51.196556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18253f8a-eda9-4db6-a922-542554112b96 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:51.209553 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88624b-7a81-4c9b-aa19-515827c6a678 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:51.217547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 47/91] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:42:51 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:42:51.218626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18253f8a-eda9-4db6-a922-542554112b96 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:51.273061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153648c0-0a5a-46f8-9374-70175e41e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:51.273786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153648c0-0a5a-46f8-9374-70175e41e158 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:51.274067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153648c0-0a5a-46f8-9374-70175e41e158 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:51.274337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153648c0-0a5a-46f8-9374-70175e41e158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:51.275244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153648c0-0a5a-46f8-9374-70175e41e158 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a, user.id=03485317eebc406bacc978bde43ff42a) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:51.275552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153648c0-0a5a-46f8-9374-70175e41e158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:51.277380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153648c0-0a5a-46f8-9374-70175e41e158 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:51.283243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 45/92] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:42:51 2022] GET /identity/v3/role_assignments?user.id=03485317eebc406bacc978bde43ff42a&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:51.289409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153648c0-0a5a-46f8-9374-70175e41e158 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:51.336865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18253f8a-eda9-4db6-a922-542554112b96 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:51.376317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b308825-a4b1-40d1-b0df-c605a13f4a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:51.377362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b308825-a4b1-40d1-b0df-c605a13f4a46 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:51.377847 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b308825-a4b1-40d1-b0df-c605a13f4a46 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:51.378272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b308825-a4b1-40d1-b0df-c605a13f4a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:51.461516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153648c0-0a5a-46f8-9374-70175e41e158 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:51.480713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b308825-a4b1-40d1-b0df-c605a13f4a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:51.482264 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b308825-a4b1-40d1-b0df-c605a13f4a46 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:51.495236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb115e-673f-4d27-b9e1-0c6bce4acb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:51.496176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb115e-673f-4d27-b9e1-0c6bce4acb04 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:51.496460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb115e-673f-4d27-b9e1-0c6bce4acb04 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:51.496735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb115e-673f-4d27-b9e1-0c6bce4acb04 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:51.499122 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb115e-673f-4d27-b9e1-0c6bce4acb04 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:51.500916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb115e-673f-4d27-b9e1-0c6bce4acb04 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:51.502863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 46/93] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:51 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:51.509055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb115e-673f-4d27-b9e1-0c6bce4acb04 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:51.588623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 48/94] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:42:51.594619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b308825-a4b1-40d1-b0df-c605a13f4a46 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:51.615118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb115e-673f-4d27-b9e1-0c6bce4acb04 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:51.655525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95d98c-db70-43b3-a2f5-e14e0fe5d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:51.656192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d98c-db70-43b3-a2f5-e14e0fe5d270 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:51.656467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d98c-db70-43b3-a2f5-e14e0fe5d270 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:51.656738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d98c-db70-43b3-a2f5-e14e0fe5d270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:51.657947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95d98c-db70-43b3-a2f5-e14e0fe5d270 None admin] RBAC: Adding query filter params (role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a, user.id=e49e7be519494a34b3624efb00d6101f) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:51.658266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95d98c-db70-43b3-a2f5-e14e0fe5d270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:51.659780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95d98c-db70-43b3-a2f5-e14e0fe5d270 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:51.665946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 47/95] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:42:51 2022] GET /identity/v3/role_assignments?user.id=e49e7be519494a34b3624efb00d6101f&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=812e67b7a9204b8f925c8e613b2209de => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:51.725970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b308825-a4b1-40d1-b0df-c605a13f4a46 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:51.765913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a0064-34de-44a3-a6f0-7766aaf9d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:51.767199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a0064-34de-44a3-a6f0-7766aaf9d5de None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:51.767688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a0064-34de-44a3-a6f0-7766aaf9d5de None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:51.768155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a0064-34de-44a3-a6f0-7766aaf9d5de None admin] PATH_INFO: `/v3/projects/fb52ce127a3247f4a66f1f717d136c0e` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:51.769745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a0064-34de-44a3-a6f0-7766aaf9d5de None admin] RBAC: Authorizing `identity:get_project(project_id=fb52ce127a3247f4a66f1f717d136c0e)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:51.771585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a0064-34de-44a3-a6f0-7766aaf9d5de None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:51.773969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 49/96] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:51 2022] GET /identity/v3/projects/fb52ce127a3247f4a66f1f717d136c0e => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:51.780339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95d98c-db70-43b3-a2f5-e14e0fe5d270 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:51.887767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95d98c-db70-43b3-a2f5-e14e0fe5d270 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:51.922307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4887df-77e8-48a6-a829-01b8b8de4162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:51.923369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4887df-77e8-48a6-a829-01b8b8de4162 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:51.923844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4887df-77e8-48a6-a829-01b8b8de4162 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:51.924323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4887df-77e8-48a6-a829-01b8b8de4162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:51.925408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4887df-77e8-48a6-a829-01b8b8de4162 None admin] RBAC: Adding query filter params (role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=fb52ce127a3247f4a66f1f717d136c0e, user.id=e49e7be519494a34b3624efb00d6101f) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:51.925914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4887df-77e8-48a6-a829-01b8b8de4162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:51.927634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4887df-77e8-48a6-a829-01b8b8de4162 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:51.933604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 48/97] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:42:51 2022] GET /identity/v3/role_assignments?user.id=e49e7be519494a34b3624efb00d6101f&scope.project.id=fb52ce127a3247f4a66f1f717d136c0e&role.id=fda329dea4e7408c9791a6554d482329 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:53.741311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2f2c-6af2-42e0-95d6-f2b635d3b343 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:53.741798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2f2c-6af2-42e0-95d6-f2b635d3b343 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:53.741798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2f2c-6af2-42e0-95d6-f2b635d3b343 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:53.743326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 50/98] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:53.751161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82ce83-8a8e-46eb-8cc9-facfc97367f1 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:53.751161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82ce83-8a8e-46eb-8cc9-facfc97367f1 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:53.751161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82ce83-8a8e-46eb-8cc9-facfc97367f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:53.767504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-1d82ce83-8a8e-46eb-8cc9-facfc97367f1 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:53.768984 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1d82ce83-8a8e-46eb-8cc9-facfc97367f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:53.833699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 49/99] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:53.856032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2f2c-6af2-42e0-95d6-f2b635d3b343 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:53.958023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2f2c-6af2-42e0-95d6-f2b635d3b343 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:53.992260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211411a-6c0d-4fb1-a49f-14bf5690173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:53.993463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211411a-6c0d-4fb1-a49f-14bf5690173f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:53.993949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211411a-6c0d-4fb1-a49f-14bf5690173f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:53.994410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211411a-6c0d-4fb1-a49f-14bf5690173f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:54.004983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211411a-6c0d-4fb1-a49f-14bf5690173f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-5211411a-6c0d-4fb1-a49f-14bf5690173f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:54.012784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:54.013724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:54.014676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:42:54.016758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 51/100] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:54.022852 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82ce83-8a8e-46eb-8cc9-facfc97367f1 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:54.119184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82ce83-8a8e-46eb-8cc9-facfc97367f1 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:54.152728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832ac4a-e7d3-4e63-9d1a-fc035061c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:54.153702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832ac4a-e7d3-4e63-9d1a-fc035061c845 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:54.154116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832ac4a-e7d3-4e63-9d1a-fc035061c845 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:54.154518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832ac4a-e7d3-4e63-9d1a-fc035061c845 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:54.155402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832ac4a-e7d3-4e63-9d1a-fc035061c845 None admin] RBAC: Adding query filter params (name=member) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:54.155843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832ac4a-e7d3-4e63-9d1a-fc035061c845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:54.157452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832ac4a-e7d3-4e63-9d1a-fc035061c845 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:54.166013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 50/101] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:54.171862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211411a-6c0d-4fb1-a49f-14bf5690173f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:54.274140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211411a-6c0d-4fb1-a49f-14bf5690173f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:54.307080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184b4a3-1b14-4e73-a644-ac1668be83df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:54.308220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184b4a3-1b14-4e73-a644-ac1668be83df None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:54.308639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184b4a3-1b14-4e73-a644-ac1668be83df None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:54.309047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184b4a3-1b14-4e73-a644-ac1668be83df None admin] PATH_INFO: `/v3/users/e49e7be519494a34b3624efb00d6101f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:54.310455 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184b4a3-1b14-4e73-a644-ac1668be83df None admin] RBAC: Authorizing `identity:get_user(user_id=e49e7be519494a34b3624efb00d6101f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:54.312144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184b4a3-1b14-4e73-a644-ac1668be83df None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:54.314235 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 52/102] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:54 2022] GET /identity/v3/users/e49e7be519494a34b3624efb00d6101f => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:54.320078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832ac4a-e7d3-4e63-9d1a-fc035061c845 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:54.418994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832ac4a-e7d3-4e63-9d1a-fc035061c845 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:54.467642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050aea-b98e-45f9-96d2-f1adcbd61dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:54.468540 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050aea-b98e-45f9-96d2-f1adcbd61dad None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:54.468824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050aea-b98e-45f9-96d2-f1adcbd61dad None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:54.469097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050aea-b98e-45f9-96d2-f1adcbd61dad None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:54.470325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea050aea-b98e-45f9-96d2-f1adcbd61dad None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:54.471780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea050aea-b98e-45f9-96d2-f1adcbd61dad None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:54.473790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 51/103] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:54 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:54.480021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184b4a3-1b14-4e73-a644-ac1668be83df None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:54.579831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184b4a3-1b14-4e73-a644-ac1668be83df None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:54.615044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c75f5-f857-453f-8b7f-79152e051a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:54.616107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c75f5-f857-453f-8b7f-79152e051a02 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:54.616391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c75f5-f857-453f-8b7f-79152e051a02 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:54.616668 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c75f5-f857-453f-8b7f-79152e051a02 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/users/e49e7be519494a34b3624efb00d6101f/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:54.618824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c75f5-f857-453f-8b7f-79152e051a02 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de0bf8f19d4705b1534c7d42f2e99a, user_id=e49e7be519494a34b3624efb00d6101f, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:54.620302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c75f5-f857-453f-8b7f-79152e051a02 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:54.644200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 53/104] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:42:54 2022] PUT /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/users/e49e7be519494a34b3624efb00d6101f/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:42:54.826741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5c749-758d-450b-b0a8-19e8caf4187b None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:54.827409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5c749-758d-450b-b0a8-19e8caf4187b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:54.827409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5c749-758d-450b-b0a8-19e8caf4187b None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:54.828713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 52/105] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:54.834401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2adf7-6630-4dbc-91a7-da1802a9a5a0 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:54.834882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2adf7-6630-4dbc-91a7-da1802a9a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:54.835028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2adf7-6630-4dbc-91a7-da1802a9a5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:54.854341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-52d2adf7-6630-4dbc-91a7-da1802a9a5a0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:54.855572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-52d2adf7-6630-4dbc-91a7-da1802a9a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:54.952248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 54/106] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:54.986580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5c749-758d-450b-b0a8-19e8caf4187b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:55.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f10f1f-609c-42a9-8e91-209fe85f0858 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.063185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f10f1f-609c-42a9-8e91-209fe85f0858 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.063666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f10f1f-609c-42a9-8e91-209fe85f0858 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.065234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 55/107] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:55.070634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624da9f-f313-40e9-8805-63c1b91ad1ea None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.071276 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624da9f-f313-40e9-8805-63c1b91ad1ea None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.071746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624da9f-f313-40e9-8805-63c1b91ad1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.097559 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a624da9f-f313-40e9-8805-63c1b91ad1ea None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:55.099136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a624da9f-f313-40e9-8805-63c1b91ad1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:55.135032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5c749-758d-450b-b0a8-19e8caf4187b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:55.186123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61182c57-f985-457b-8e51-8b5aae3816c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:55.187183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61182c57-f985-457b-8e51-8b5aae3816c1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.187465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61182c57-f985-457b-8e51-8b5aae3816c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.187737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61182c57-f985-457b-8e51-8b5aae3816c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.199492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61182c57-f985-457b-8e51-8b5aae3816c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-61182c57-f985-457b-8e51-8b5aae3816c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:55.207474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:55.208437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:42:55.209182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:42:55.211428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 53/108] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:55.212862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a718e-3f30-49be-8623-39be55983a76 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.213351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a718e-3f30-49be-8623-39be55983a76 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.213794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a718e-3f30-49be-8623-39be55983a76 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.213890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 56/109] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:42:55.215295 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 54/110] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:55.220882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2f416-0890-49bc-807e-d54d2b57d801 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.221920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a718e-3f30-49be-8623-39be55983a76 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:55.223134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2f416-0890-49bc-807e-d54d2b57d801 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.225161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2f416-0890-49bc-807e-d54d2b57d801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.250443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-efd2f416-0890-49bc-807e-d54d2b57d801 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:55.251928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-efd2f416-0890-49bc-807e-d54d2b57d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:55.340879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a718e-3f30-49be-8623-39be55983a76 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:55.343085 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 57/111] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:42:55.351959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2f416-0890-49bc-807e-d54d2b57d801 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:55.390999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23917d8e-e9b1-4e73-b83d-c5f82e68c58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:55.392027 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917d8e-e9b1-4e73-b83d-c5f82e68c58c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.392663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917d8e-e9b1-4e73-b83d-c5f82e68c58c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.393135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917d8e-e9b1-4e73-b83d-c5f82e68c58c None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.394854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23917d8e-e9b1-4e73-b83d-c5f82e68c58c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:55.395366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23917d8e-e9b1-4e73-b83d-c5f82e68c58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:55.397002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23917d8e-e9b1-4e73-b83d-c5f82e68c58c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:55.408378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 55/112] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:55.415492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80aa9-9adb-438a-9957-4b982b354c70 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.416030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80aa9-9adb-438a-9957-4b982b354c70 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.416654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80aa9-9adb-438a-9957-4b982b354c70 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.419025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 56/113] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:55.420359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba80aa9-9adb-438a-9957-4b982b354c70 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:55.469782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2f416-0890-49bc-807e-d54d2b57d801 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:55.507662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6620897-41ef-4487-adb4-9658e38ff367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:55.508505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6620897-41ef-4487-adb4-9658e38ff367 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.508802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6620897-41ef-4487-adb4-9658e38ff367 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.509068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6620897-41ef-4487-adb4-9658e38ff367 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.519435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6620897-41ef-4487-adb4-9658e38ff367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a6620897-41ef-4487-adb4-9658e38ff367 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:55.527622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:55.528474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 58/114] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:42:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:55.534112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6620897-41ef-4487-adb4-9658e38ff367 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:55.542718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba80aa9-9adb-438a-9957-4b982b354c70 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:55.578917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c12df-58f6-43ff-9145-c2acb3cdcce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:55.579793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c12df-58f6-43ff-9145-c2acb3cdcce4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.580086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c12df-58f6-43ff-9145-c2acb3cdcce4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.580371 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c12df-58f6-43ff-9145-c2acb3cdcce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.582094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c12df-58f6-43ff-9145-c2acb3cdcce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:55.583894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c12df-58f6-43ff-9145-c2acb3cdcce4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:55.590947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 57/115] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:55.590947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55c79-ab31-440d-8dda-ebecb94f5094 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.590947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55c79-ab31-440d-8dda-ebecb94f5094 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.590947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f55c79-ab31-440d-8dda-ebecb94f5094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.608750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-50f55c79-ab31-440d-8dda-ebecb94f5094 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:55.610564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-50f55c79-ab31-440d-8dda-ebecb94f5094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:55.626012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6620897-41ef-4487-adb4-9658e38ff367 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:55.658787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6ee8-1c12-42f4-ba71-a2880de6eb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:55.659677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6ee8-1c12-42f4-ba71-a2880de6eb88 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.659962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6ee8-1c12-42f4-ba71-a2880de6eb88 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.660239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6ee8-1c12-42f4-ba71-a2880de6eb88 None admin] PATH_INFO: `/v3/users/03485317eebc406bacc978bde43ff42a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.661498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6ee8-1c12-42f4-ba71-a2880de6eb88 None admin] RBAC: Authorizing `identity:get_user(user_id=03485317eebc406bacc978bde43ff42a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:55.662969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6ee8-1c12-42f4-ba71-a2880de6eb88 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:55.664596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 59/116] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:55 2022] GET /identity/v3/users/03485317eebc406bacc978bde43ff42a => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:55.670987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d4bcd-21b7-43c3-a68d-ce7b59e29aa1 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.671280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d4bcd-21b7-43c3-a68d-ce7b59e29aa1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.671562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d4bcd-21b7-43c3-a68d-ce7b59e29aa1 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.672943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 60/117] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:55.673511 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d4bcd-21b7-43c3-a68d-ce7b59e29aa1 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:55.685654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 58/118] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:55.694237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f55c79-ab31-440d-8dda-ebecb94f5094 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:55.784332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d4bcd-21b7-43c3-a68d-ce7b59e29aa1 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:55.797233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f55c79-ab31-440d-8dda-ebecb94f5094 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:55.817238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07ccd9-cb3f-4a07-ae03-f64d3c9e7c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:55.818140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07ccd9-cb3f-4a07-ae03-f64d3c9e7c5c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.818617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07ccd9-cb3f-4a07-ae03-f64d3c9e7c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.819183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07ccd9-cb3f-4a07-ae03-f64d3c9e7c5c None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.820596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07ccd9-cb3f-4a07-ae03-f64d3c9e7c5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:55.821135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07ccd9-cb3f-4a07-ae03-f64d3c9e7c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:55.823249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07ccd9-cb3f-4a07-ae03-f64d3c9e7c5c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:55.836376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 61/119] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:42:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:55.836376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07ccd9-cb3f-4a07-ae03-f64d3c9e7c5c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:55.839820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be34f5-f3ac-4974-b7b4-874e7e81d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:55.840461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be34f5-f3ac-4974-b7b4-874e7e81d480 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.841615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be34f5-f3ac-4974-b7b4-874e7e81d480 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.841615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be34f5-f3ac-4974-b7b4-874e7e81d480 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.841794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be34f5-f3ac-4974-b7b4-874e7e81d480 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:55.843188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be34f5-f3ac-4974-b7b4-874e7e81d480 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:55.868810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 59/120] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:42:55 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:42:55.869864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d2c00-200f-4301-9695-f068536086d5 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.870165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d2c00-200f-4301-9695-f068536086d5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.870440 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d2c00-200f-4301-9695-f068536086d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.888589 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-eb9d2c00-200f-4301-9695-f068536086d5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:55.889846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-eb9d2c00-200f-4301-9695-f068536086d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:55.953829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07ccd9-cb3f-4a07-ae03-f64d3c9e7c5c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:55.959957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 60/121] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:55.960620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d2c00-200f-4301-9695-f068536086d5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:55.991227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192f5f6-0629-437e-89ac-24569dc1c414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:55.992502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192f5f6-0629-437e-89ac-24569dc1c414 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:55.992987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192f5f6-0629-437e-89ac-24569dc1c414 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:55.993581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192f5f6-0629-437e-89ac-24569dc1c414 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:55.995340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192f5f6-0629-437e-89ac-24569dc1c414 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:55.997129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192f5f6-0629-437e-89ac-24569dc1c414 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:55.999174 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 62/122] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:55 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:56.000918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192f5f6-0629-437e-89ac-24569dc1c414 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.066119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d2c00-200f-4301-9695-f068536086d5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.106554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fd2e0-8111-4d4a-ba58-4e7a2697e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.107733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fd2e0-8111-4d4a-ba58-4e7a2697e12f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.108261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fd2e0-8111-4d4a-ba58-4e7a2697e12f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.108751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fd2e0-8111-4d4a-ba58-4e7a2697e12f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.109084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192f5f6-0629-437e-89ac-24569dc1c414 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.121820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fd2e0-8111-4d4a-ba58-4e7a2697e12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-0d7fd2e0-8111-4d4a-ba58-4e7a2697e12f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:56.133105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:56.134066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:56.134822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:42:56.136791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 61/123] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:56.138606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fd2e0-8111-4d4a-ba58-4e7a2697e12f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.152051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec6670-175a-467a-b9e4-32caf3c6bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.152960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec6670-175a-467a-b9e4-32caf3c6bed0 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.153250 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec6670-175a-467a-b9e4-32caf3c6bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.153549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec6670-175a-467a-b9e4-32caf3c6bed0 None admin] PATH_INFO: `/v3/users/e49e7be519494a34b3624efb00d6101f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.154788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec6670-175a-467a-b9e4-32caf3c6bed0 None admin] RBAC: Authorizing `identity:get_user(user_id=e49e7be519494a34b3624efb00d6101f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:56.156267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec6670-175a-467a-b9e4-32caf3c6bed0 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:56.162340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 63/124] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:55 2022] GET /identity/v3/users/e49e7be519494a34b3624efb00d6101f => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:56.162340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec6670-175a-467a-b9e4-32caf3c6bed0 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.255241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fd2e0-8111-4d4a-ba58-4e7a2697e12f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.267562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec6670-175a-467a-b9e4-32caf3c6bed0 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.289082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b849df-9218-4051-bfb9-c19d89ff1f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.290250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b849df-9218-4051-bfb9-c19d89ff1f2d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.290757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b849df-9218-4051-bfb9-c19d89ff1f2d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.291251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b849df-9218-4051-bfb9-c19d89ff1f2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.302750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166da96-2a96-4af6-8204-4f3cec7945f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.303663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166da96-2a96-4af6-8204-4f3cec7945f5 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.303767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b849df-9218-4051-bfb9-c19d89ff1f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:56.303944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166da96-2a96-4af6-8204-4f3cec7945f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.304224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166da96-2a96-4af6-8204-4f3cec7945f5 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/users/03485317eebc406bacc978bde43ff42a/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.306246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166da96-2a96-4af6-8204-4f3cec7945f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de0bf8f19d4705b1534c7d42f2e99a, user_id=03485317eebc406bacc978bde43ff42a, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:56.307689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166da96-2a96-4af6-8204-4f3cec7945f5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-50b849df-9218-4051-bfb9-c19d89ff1f2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:56.314600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:56.316014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:42:56.317014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:42:56.319869 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 62/125] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:56.320976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b849df-9218-4051-bfb9-c19d89ff1f2d None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.328498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 64/126] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:42:56 2022] PUT /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/users/03485317eebc406bacc978bde43ff42a/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:42:56.329523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166da96-2a96-4af6-8204-4f3cec7945f5 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.440121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b849df-9218-4051-bfb9-c19d89ff1f2d None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.451924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166da96-2a96-4af6-8204-4f3cec7945f5 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.481413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0dbe3-19f1-4729-9a90-071630512de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.482560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0dbe3-19f1-4729-9a90-071630512de8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.483113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0dbe3-19f1-4729-9a90-071630512de8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.483598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0dbe3-19f1-4729-9a90-071630512de8 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.484650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0dbe3-19f1-4729-9a90-071630512de8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:56.485194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0dbe3-19f1-4729-9a90-071630512de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:56.486913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0dbe3-19f1-4729-9a90-071630512de8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:56.498342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 63/127] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:42:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:56.500409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0dbe3-19f1-4729-9a90-071630512de8 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.527402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b305-cf10-4c98-b7b8-9f35ecf77aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.528362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b305-cf10-4c98-b7b8-9f35ecf77aa3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.528596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b305-cf10-4c98-b7b8-9f35ecf77aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.528887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b305-cf10-4c98-b7b8-9f35ecf77aa3 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.534273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300b305-cf10-4c98-b7b8-9f35ecf77aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:56.535832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300b305-cf10-4c98-b7b8-9f35ecf77aa3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:56.537905 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 65/128] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:56 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:56.541493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b305-cf10-4c98-b7b8-9f35ecf77aa3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.624413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0dbe3-19f1-4729-9a90-071630512de8 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.665404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79eeb86-2055-44b3-a507-5681783d6b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.666232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79eeb86-2055-44b3-a507-5681783d6b8f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.666527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79eeb86-2055-44b3-a507-5681783d6b8f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.667121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79eeb86-2055-44b3-a507-5681783d6b8f None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.668163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79eeb86-2055-44b3-a507-5681783d6b8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:56.668479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79eeb86-2055-44b3-a507-5681783d6b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:56.670636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79eeb86-2055-44b3-a507-5681783d6b8f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:56.672355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b305-cf10-4c98-b7b8-9f35ecf77aa3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.680241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 64/129] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:42:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:56.681556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79eeb86-2055-44b3-a507-5681783d6b8f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.710442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f1fb0-8c92-4b7c-8c80-e23906d61f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.711739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f1fb0-8c92-4b7c-8c80-e23906d61f8f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.712124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f1fb0-8c92-4b7c-8c80-e23906d61f8f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.712718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f1fb0-8c92-4b7c-8c80-e23906d61f8f None admin] PATH_INFO: `/v3/users/e49e7be519494a34b3624efb00d6101f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.714233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f1fb0-8c92-4b7c-8c80-e23906d61f8f None admin] RBAC: Authorizing `identity:get_user(user_id=e49e7be519494a34b3624efb00d6101f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:56.716579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f1fb0-8c92-4b7c-8c80-e23906d61f8f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:56.719309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 66/130] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:56 2022] GET /identity/v3/users/e49e7be519494a34b3624efb00d6101f => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:56.720099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f1fb0-8c92-4b7c-8c80-e23906d61f8f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.848000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79eeb86-2055-44b3-a507-5681783d6b8f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.882467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f1fb0-8c92-4b7c-8c80-e23906d61f8f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:56.914024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaa929-6f98-4df2-8485-968d3cacc295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.914947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaa929-6f98-4df2-8485-968d3cacc295 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.915322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaa929-6f98-4df2-8485-968d3cacc295 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.915607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaa929-6f98-4df2-8485-968d3cacc295 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/users/e49e7be519494a34b3624efb00d6101f/roles/812e67b7a9204b8f925c8e613b2209de` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.916291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c796155-71c4-4090-acc5-9f9d9fea7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:56.917197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c796155-71c4-4090-acc5-9f9d9fea7c10 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:56.917505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c796155-71c4-4090-acc5-9f9d9fea7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:56.917786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c796155-71c4-4090-acc5-9f9d9fea7c10 None admin] PATH_INFO: `/v3/users/21e43441704847e7bde34f8c2e87b4a2` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:56.917949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaa929-6f98-4df2-8485-968d3cacc295 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de0bf8f19d4705b1534c7d42f2e99a, user_id=e49e7be519494a34b3624efb00d6101f, role_id=812e67b7a9204b8f925c8e613b2209de)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:56.919382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaa929-6f98-4df2-8485-968d3cacc295 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:56.933979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c796155-71c4-4090-acc5-9f9d9fea7c10 None admin] RBAC: Authorizing `identity:get_user(user_id=21e43441704847e7bde34f8c2e87b4a2)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:56.935582 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c796155-71c4-4090-acc5-9f9d9fea7c10 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:56.937659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 67/131] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:56 2022] GET /identity/v3/users/21e43441704847e7bde34f8c2e87b4a2 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:56.938518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c796155-71c4-4090-acc5-9f9d9fea7c10 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:56.955531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 65/132] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:42:56 2022] PUT /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/users/e49e7be519494a34b3624efb00d6101f/roles/812e67b7a9204b8f925c8e613b2209de => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:42:56.956378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaa929-6f98-4df2-8485-968d3cacc295 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:57.092204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c796155-71c4-4090-acc5-9f9d9fea7c10 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:57.178828 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0083-94b9-483e-a265-f9c3283adca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:57.179732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0083-94b9-483e-a265-f9c3283adca5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:57.180023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0083-94b9-483e-a265-f9c3283adca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:57.180302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0083-94b9-483e-a265-f9c3283adca5 None admin] PATH_INFO: `/v3/projects/fb52ce127a3247f4a66f1f717d136c0e` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:57.186194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0083-94b9-483e-a265-f9c3283adca5 None admin] RBAC: Authorizing `identity:get_project(project_id=fb52ce127a3247f4a66f1f717d136c0e)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:57.187730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0083-94b9-483e-a265-f9c3283adca5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:57.189674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 68/133] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:56 2022] GET /identity/v3/projects/fb52ce127a3247f4a66f1f717d136c0e => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:57.196819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0083-94b9-483e-a265-f9c3283adca5 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:57.201325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaa929-6f98-4df2-8485-968d3cacc295 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:57.281063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c78a0-9f0f-41ee-bbcd-53a59e1a3697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:57.281850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c78a0-9f0f-41ee-bbcd-53a59e1a3697 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:57.282142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c78a0-9f0f-41ee-bbcd-53a59e1a3697 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:57.282429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c78a0-9f0f-41ee-bbcd-53a59e1a3697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:57.357794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c78a0-9f0f-41ee-bbcd-53a59e1a3697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:57.359472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c78a0-9f0f-41ee-bbcd-53a59e1a3697 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:57.432155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0083-94b9-483e-a265-f9c3283adca5 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:57.484394 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103dde6-633f-4177-b5a7-51c8481c01b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:57.485336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103dde6-633f-4177-b5a7-51c8481c01b6 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:57.485626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103dde6-633f-4177-b5a7-51c8481c01b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:57.485905 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103dde6-633f-4177-b5a7-51c8481c01b6 None admin] PATH_INFO: `/v3/projects/fb52ce127a3247f4a66f1f717d136c0e/users/e49e7be519494a34b3624efb00d6101f/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:57.488651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103dde6-633f-4177-b5a7-51c8481c01b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb52ce127a3247f4a66f1f717d136c0e, user_id=e49e7be519494a34b3624efb00d6101f, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:57.490260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103dde6-633f-4177-b5a7-51c8481c01b6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:57.499509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 66/134] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:42:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:42:57.506089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c78a0-9f0f-41ee-bbcd-53a59e1a3697 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:57.516184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 69/135] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:42:57 2022] PUT /identity/v3/projects/fb52ce127a3247f4a66f1f717d136c0e/users/e49e7be519494a34b3624efb00d6101f/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:42:57.635682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c78a0-9f0f-41ee-bbcd-53a59e1a3697 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:57.683110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cf4aa-b612-4da3-97d7-449567eef2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:57.684018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cf4aa-b612-4da3-97d7-449567eef2bf None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:57.684323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cf4aa-b612-4da3-97d7-449567eef2bf None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:57.684605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cf4aa-b612-4da3-97d7-449567eef2bf None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:57.686097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cf4aa-b612-4da3-97d7-449567eef2bf None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:57.687567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cf4aa-b612-4da3-97d7-449567eef2bf None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:57.689306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 67/136] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:57 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:57.695291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103dde6-633f-4177-b5a7-51c8481c01b6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:57.814398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103dde6-633f-4177-b5a7-51c8481c01b6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:57.886185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb62fc9-3de2-4cde-af29-06657e6f764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:57.887655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb62fc9-3de2-4cde-af29-06657e6f764d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:57.888148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb62fc9-3de2-4cde-af29-06657e6f764d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:57.888625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb62fc9-3de2-4cde-af29-06657e6f764d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:57.889738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb62fc9-3de2-4cde-af29-06657e6f764d None admin] RBAC: Adding query filter params (role.id=7e055f7884c84073918d471ba5d53247, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a, user.id=21e43441704847e7bde34f8c2e87b4a2) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:57.890244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb62fc9-3de2-4cde-af29-06657e6f764d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:57.891909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb62fc9-3de2-4cde-af29-06657e6f764d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:57.903330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 70/137] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:42:57 2022] GET /identity/v3/role_assignments?user.id=21e43441704847e7bde34f8c2e87b4a2&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=7e055f7884c84073918d471ba5d53247 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:57.995639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2007a6-87b4-4f41-9902-af6e1f89ee1d None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:57.996160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2007a6-87b4-4f41-9902-af6e1f89ee1d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:57.996235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2007a6-87b4-4f41-9902-af6e1f89ee1d None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:57.997864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 68/138] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:58.003715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97bbc6-96b2-4e19-a9bd-a24859de4332 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:58.004331 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97bbc6-96b2-4e19-a9bd-a24859de4332 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:58.004814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97bbc6-96b2-4e19-a9bd-a24859de4332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:58.030345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-cb97bbc6-96b2-4e19-a9bd-a24859de4332 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:58.031923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cb97bbc6-96b2-4e19-a9bd-a24859de4332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:58.115136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 71/139] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:42:58.150695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2007a6-87b4-4f41-9902-af6e1f89ee1d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:58.269984 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2007a6-87b4-4f41-9902-af6e1f89ee1d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:58.304953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50efceb-a3f9-40e5-8b7c-ce851e6c0e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:58.305803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50efceb-a3f9-40e5-8b7c-ce851e6c0e99 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:58.306093 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50efceb-a3f9-40e5-8b7c-ce851e6c0e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:58.306370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50efceb-a3f9-40e5-8b7c-ce851e6c0e99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:58.316856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50efceb-a3f9-40e5-8b7c-ce851e6c0e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-a50efceb-a3f9-40e5-8b7c-ce851e6c0e99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:42:58.324582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:42:58.325512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:42:58.326301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 69/140] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:42:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:42:58.334687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97bbc6-96b2-4e19-a9bd-a24859de4332 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:58.490553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97bbc6-96b2-4e19-a9bd-a24859de4332 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:58.550877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af12cd-785b-481b-b0a7-18845a92d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:58.551578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af12cd-785b-481b-b0a7-18845a92d749 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:58.551863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af12cd-785b-481b-b0a7-18845a92d749 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:58.552212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af12cd-785b-481b-b0a7-18845a92d749 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:58.552983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af12cd-785b-481b-b0a7-18845a92d749 None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:58.553306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af12cd-785b-481b-b0a7-18845a92d749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:58.554759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af12cd-785b-481b-b0a7-18845a92d749 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:58.570631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 72/141] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:58.576507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50efceb-a3f9-40e5-8b7c-ce851e6c0e99 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:58.642065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299efc-0420-4373-a13e-4ccd60dbea1c None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:58.642365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299efc-0420-4373-a13e-4ccd60dbea1c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:58.642633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299efc-0420-4373-a13e-4ccd60dbea1c None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:58.644025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 73/142] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:58.649134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c71e2-0f1d-4272-8611-99ee2b514bbb None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:58.649497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c71e2-0f1d-4272-8611-99ee2b514bbb None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:58.649789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c71e2-0f1d-4272-8611-99ee2b514bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:58.670921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e21c71e2-0f1d-4272-8611-99ee2b514bbb None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:58.673019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e21c71e2-0f1d-4272-8611-99ee2b514bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:42:58.725043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50efceb-a3f9-40e5-8b7c-ce851e6c0e99 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:58.751214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 74/143] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:42:58.780217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c71e2-0f1d-4272-8611-99ee2b514bbb None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:58.794147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bdd1a-e718-458c-8575-236216638680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:58.795045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bdd1a-e718-458c-8575-236216638680 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:58.796055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bdd1a-e718-458c-8575-236216638680 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:58.796396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bdd1a-e718-458c-8575-236216638680 None admin] PATH_INFO: `/v3/users/e49e7be519494a34b3624efb00d6101f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:58.799189 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bdd1a-e718-458c-8575-236216638680 None admin] RBAC: Authorizing `identity:get_user(user_id=e49e7be519494a34b3624efb00d6101f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:58.800673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bdd1a-e718-458c-8575-236216638680 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:58.802396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 70/144] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:42:58 2022] GET /identity/v3/users/e49e7be519494a34b3624efb00d6101f => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:58.810749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bdd1a-e718-458c-8575-236216638680 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:58.936405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c71e2-0f1d-4272-8611-99ee2b514bbb None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:58.989395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bdd1a-e718-458c-8575-236216638680 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:58.992801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5813-8bd6-4587-9e92-fc3d5b81855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:58.993873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5813-8bd6-4587-9e92-fc3d5b81855d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:58.994343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5813-8bd6-4587-9e92-fc3d5b81855d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:58.994803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5813-8bd6-4587-9e92-fc3d5b81855d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:59.002081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5813-8bd6-4587-9e92-fc3d5b81855d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:59.003854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5813-8bd6-4587-9e92-fc3d5b81855d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:59.005893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 75/145] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:42:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:59.017511 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5813-8bd6-4587-9e92-fc3d5b81855d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:59.024510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bb600-2932-4b57-a3f1-f122f27dbe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:59.025230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bb600-2932-4b57-a3f1-f122f27dbe3e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:59.025548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bb600-2932-4b57-a3f1-f122f27dbe3e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:59.025829 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bb600-2932-4b57-a3f1-f122f27dbe3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:59.093761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bb600-2932-4b57-a3f1-f122f27dbe3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:59.095247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bb600-2932-4b57-a3f1-f122f27dbe3e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:59.197009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 71/146] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:42:59.202541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bb600-2932-4b57-a3f1-f122f27dbe3e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:59.237473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5813-8bd6-4587-9e92-fc3d5b81855d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:59.280536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d2ea4-dfc8-4d76-a7f2-1b63108f4476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:59.281592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d2ea4-dfc8-4d76-a7f2-1b63108f4476 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:59.283162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d2ea4-dfc8-4d76-a7f2-1b63108f4476 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:59.283627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d2ea4-dfc8-4d76-a7f2-1b63108f4476 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:59.285275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d2ea4-dfc8-4d76-a7f2-1b63108f4476 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:59.287120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d2ea4-dfc8-4d76-a7f2-1b63108f4476 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:59.327869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 76/147] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:42:59 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:42:59.373914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bb600-2932-4b57-a3f1-f122f27dbe3e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:59.416695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2c2b8-4474-4f29-8dd2-a4ff6de00a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:59.417998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2c2b8-4474-4f29-8dd2-a4ff6de00a68 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:59.418479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2c2b8-4474-4f29-8dd2-a4ff6de00a68 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:59.418944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2c2b8-4474-4f29-8dd2-a4ff6de00a68 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:59.420456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2c2b8-4474-4f29-8dd2-a4ff6de00a68 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:59.422149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2c2b8-4474-4f29-8dd2-a4ff6de00a68 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:59.424096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 72/148] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:42:59 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:42:59.430475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d2ea4-dfc8-4d76-a7f2-1b63108f4476 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:42:59.570241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d2ea4-dfc8-4d76-a7f2-1b63108f4476 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:42:59.608585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ceef14-baf5-48ac-9ad3-4783c84ebfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:42:59.609273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceef14-baf5-48ac-9ad3-4783c84ebfdb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:59.609589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceef14-baf5-48ac-9ad3-4783c84ebfdb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:59.609868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceef14-baf5-48ac-9ad3-4783c84ebfdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:59.610734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ceef14-baf5-48ac-9ad3-4783c84ebfdb None admin] RBAC: Adding query filter params (role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a, user.id=e49e7be519494a34b3624efb00d6101f) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:42:59.611050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ceef14-baf5-48ac-9ad3-4783c84ebfdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:42:59.612550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ceef14-baf5-48ac-9ad3-4783c84ebfdb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:42:59.622419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 77/149] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:42:59 2022] GET /identity/v3/role_assignments?user.id=e49e7be519494a34b3624efb00d6101f&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=fda329dea4e7408c9791a6554d482329 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:42:59.957618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d18531-23d6-44c7-8d6b-c44525c97ede None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:59.958012 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d18531-23d6-44c7-8d6b-c44525c97ede None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:59.958537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d18531-23d6-44c7-8d6b-c44525c97ede None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:59.960957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 73/150] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:42:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:42:59.966431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bde6a-6e1d-4bf0-94e9-9bdfb349ce44 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:42:59.966916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bde6a-6e1d-4bf0-94e9-9bdfb349ce44 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:42:59.966997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bde6a-6e1d-4bf0-94e9-9bdfb349ce44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:42:59.990402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-553bde6a-6e1d-4bf0-94e9-9bdfb349ce44 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:42:59.991598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-553bde6a-6e1d-4bf0-94e9-9bdfb349ce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:00.076945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 78/151] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:00.100978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d18531-23d6-44c7-8d6b-c44525c97ede None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:00.225430 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d18531-23d6-44c7-8d6b-c44525c97ede None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:00.269509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66edfa-0ab7-4cf9-ac17-960be53df19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:00.270783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66edfa-0ab7-4cf9-ac17-960be53df19e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:00.271281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66edfa-0ab7-4cf9-ac17-960be53df19e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:00.271937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66edfa-0ab7-4cf9-ac17-960be53df19e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:00.286235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66edfa-0ab7-4cf9-ac17-960be53df19e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-6e66edfa-0ab7-4cf9-ac17-960be53df19e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:00.294713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:00.295643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:00.296414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:00.298975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 74/152] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:43:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:00.314567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bde6a-6e1d-4bf0-94e9-9bdfb349ce44 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:00.510364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bde6a-6e1d-4bf0-94e9-9bdfb349ce44 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:00.553409 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fff10-800e-425f-b24b-cb89a53515be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:00.554489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fff10-800e-425f-b24b-cb89a53515be None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:00.554972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fff10-800e-425f-b24b-cb89a53515be None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:00.555443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fff10-800e-425f-b24b-cb89a53515be None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:00.556446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fff10-800e-425f-b24b-cb89a53515be None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:00.556979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fff10-800e-425f-b24b-cb89a53515be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:00.558661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fff10-800e-425f-b24b-cb89a53515be None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:00.568496 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 79/153] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:00.574332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66edfa-0ab7-4cf9-ac17-960be53df19e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:00.682673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66edfa-0ab7-4cf9-ac17-960be53df19e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:00.712429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54c2f-3db1-4db9-b3ec-57d145043aaf None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:00.713064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54c2f-3db1-4db9-b3ec-57d145043aaf None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:00.713560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54c2f-3db1-4db9-b3ec-57d145043aaf None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:00.715301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 80/154] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:00.722512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0cc44-68be-412d-b212-fb5364641a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:00.723728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0cc44-68be-412d-b212-fb5364641a92 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:00.724269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0cc44-68be-412d-b212-fb5364641a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:00.724741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0cc44-68be-412d-b212-fb5364641a92 None admin] PATH_INFO: `/v3/users/03485317eebc406bacc978bde43ff42a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:00.726178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0cc44-68be-412d-b212-fb5364641a92 None admin] RBAC: Authorizing `identity:get_user(user_id=03485317eebc406bacc978bde43ff42a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:00.727836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0cc44-68be-412d-b212-fb5364641a92 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:00.729771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 75/155] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:00 2022] GET /identity/v3/users/03485317eebc406bacc978bde43ff42a => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:00.731480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99171f-e699-4d8d-8cde-7754cb5849a3 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:00.732496 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99171f-e699-4d8d-8cde-7754cb5849a3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:00.733010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99171f-e699-4d8d-8cde-7754cb5849a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:00.745786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0cc44-68be-412d-b212-fb5364641a92 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:00.764913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-fe99171f-e699-4d8d-8cde-7754cb5849a3 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:00.766529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fe99171f-e699-4d8d-8cde-7754cb5849a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:00.847427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 81/156] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:00.928932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0cc44-68be-412d-b212-fb5364641a92 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:00.933171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99171f-e699-4d8d-8cde-7754cb5849a3 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:00.971804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcd901-c69c-4fc1-a403-10b54a472492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:00.972480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcd901-c69c-4fc1-a403-10b54a472492 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:00.972775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcd901-c69c-4fc1-a403-10b54a472492 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:00.973051 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcd901-c69c-4fc1-a403-10b54a472492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.043078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcd901-c69c-4fc1-a403-10b54a472492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:01.044833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcd901-c69c-4fc1-a403-10b54a472492 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:01.085022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99171f-e699-4d8d-8cde-7754cb5849a3 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:01.121904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e477dd-21c5-440b-bc10-428e48661955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:01.123080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e477dd-21c5-440b-bc10-428e48661955 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.123558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e477dd-21c5-440b-bc10-428e48661955 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.124020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e477dd-21c5-440b-bc10-428e48661955 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.136167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e477dd-21c5-440b-bc10-428e48661955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-c3e477dd-21c5-440b-bc10-428e48661955 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:01.144660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:01.145545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:01.146361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:01.147512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 76/157] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:01.148458 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ed8bc-4508-451e-8962-2d6f46cc7f16 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.148753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ed8bc-4508-451e-8962-2d6f46cc7f16 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.149033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ed8bc-4508-451e-8962-2d6f46cc7f16 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.150249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 82/158] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:01.150385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 77/159] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:01.155504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e477dd-21c5-440b-bc10-428e48661955 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:01.155659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ed8bc-4508-451e-8962-2d6f46cc7f16 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:01.256966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e477dd-21c5-440b-bc10-428e48661955 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:01.266567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ed8bc-4508-451e-8962-2d6f46cc7f16 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:01.291378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c860e8-4baf-47eb-b2f9-2ee84ded9d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:01.292518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c860e8-4baf-47eb-b2f9-2ee84ded9d39 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.292963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c860e8-4baf-47eb-b2f9-2ee84ded9d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.293475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c860e8-4baf-47eb-b2f9-2ee84ded9d39 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.294833 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c860e8-4baf-47eb-b2f9-2ee84ded9d39 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:01.296432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c860e8-4baf-47eb-b2f9-2ee84ded9d39 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:01.298338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 83/160] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:01 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:01.300100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746e92e-9e86-41e3-9ba1-e85a71db2952 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.300528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746e92e-9e86-41e3-9ba1-e85a71db2952 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.300977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746e92e-9e86-41e3-9ba1-e85a71db2952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.301935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239220c-b323-4d27-8662-fdae39bb0fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:01.302780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239220c-b323-4d27-8662-fdae39bb0fdc None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.303328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239220c-b323-4d27-8662-fdae39bb0fdc None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.303820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239220c-b323-4d27-8662-fdae39bb0fdc None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.304719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239220c-b323-4d27-8662-fdae39bb0fdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:01.305261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239220c-b323-4d27-8662-fdae39bb0fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:01.306828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239220c-b323-4d27-8662-fdae39bb0fdc None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:01.315609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 78/161] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:01.316695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239220c-b323-4d27-8662-fdae39bb0fdc None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:01.319151 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9746e92e-9e86-41e3-9ba1-e85a71db2952 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:01.320533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9746e92e-9e86-41e3-9ba1-e85a71db2952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:01.387329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 84/162] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:01.394490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746e92e-9e86-41e3-9ba1-e85a71db2952 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:01.416336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239220c-b323-4d27-8662-fdae39bb0fdc None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:01.449424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1925-3dc2-4734-8a8d-3b9182ab9cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:01.450097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1925-3dc2-4734-8a8d-3b9182ab9cdd None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.450379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1925-3dc2-4734-8a8d-3b9182ab9cdd None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.450654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1925-3dc2-4734-8a8d-3b9182ab9cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.451500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb1925-3dc2-4734-8a8d-3b9182ab9cdd None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a, user.id=03485317eebc406bacc978bde43ff42a) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:01.451812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb1925-3dc2-4734-8a8d-3b9182ab9cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:01.453253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb1925-3dc2-4734-8a8d-3b9182ab9cdd None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:01.459548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 79/163] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:01 2022] GET /identity/v3/role_assignments?user.id=03485317eebc406bacc978bde43ff42a&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:01.460377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1925-3dc2-4734-8a8d-3b9182ab9cdd None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:01.510117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746e92e-9e86-41e3-9ba1-e85a71db2952 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:01.553019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86f5e6-c221-4efa-ae96-d799631193d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:01.554288 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86f5e6-c221-4efa-ae96-d799631193d5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.554763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86f5e6-c221-4efa-ae96-d799631193d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.555421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86f5e6-c221-4efa-ae96-d799631193d5 None admin] PATH_INFO: `/v3/users/e49e7be519494a34b3624efb00d6101f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.558505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86f5e6-c221-4efa-ae96-d799631193d5 None admin] RBAC: Authorizing `identity:get_user(user_id=e49e7be519494a34b3624efb00d6101f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:01.561021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86f5e6-c221-4efa-ae96-d799631193d5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:01.564059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 85/164] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:01 2022] GET /identity/v3/users/e49e7be519494a34b3624efb00d6101f => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:01.567119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad0b5e-19e8-4f46-92f7-6f15a448425f None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.568687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad0b5e-19e8-4f46-92f7-6f15a448425f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.571877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad0b5e-19e8-4f46-92f7-6f15a448425f None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.573671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 86/165] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:01.574982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad0b5e-19e8-4f46-92f7-6f15a448425f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:01.604868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1925-3dc2-4734-8a8d-3b9182ab9cdd None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:01.676832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1e8f4-1ed7-4a3d-b14c-dfaa1661244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:01.678150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1e8f4-1ed7-4a3d-b14c-dfaa1661244d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.678639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1e8f4-1ed7-4a3d-b14c-dfaa1661244d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.679140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1e8f4-1ed7-4a3d-b14c-dfaa1661244d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.704362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1e8f4-1ed7-4a3d-b14c-dfaa1661244d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-92b1e8f4-1ed7-4a3d-b14c-dfaa1661244d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:01.720405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:01.721428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:01.722196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:01.728138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 80/166] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:01.734947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e23119-ab75-4b70-b732-35d1dcc2879a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.735601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e23119-ab75-4b70-b732-35d1dcc2879a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.736077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e23119-ab75-4b70-b732-35d1dcc2879a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.776647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c3e23119-ab75-4b70-b732-35d1dcc2879a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:01.780357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c3e23119-ab75-4b70-b732-35d1dcc2879a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:01.798028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad0b5e-19e8-4f46-92f7-6f15a448425f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:01.846681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5237579-83e0-4a67-b1a7-5d4b3d4df580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:01.847267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5237579-83e0-4a67-b1a7-5d4b3d4df580 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:01.847572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5237579-83e0-4a67-b1a7-5d4b3d4df580 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:01.847848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5237579-83e0-4a67-b1a7-5d4b3d4df580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:01.880432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 81/167] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:01.881812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e23119-ab75-4b70-b732-35d1dcc2879a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:01.930391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5237579-83e0-4a67-b1a7-5d4b3d4df580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:01.931918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5237579-83e0-4a67-b1a7-5d4b3d4df580 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:01.996578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e23119-ab75-4b70-b732-35d1dcc2879a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.038050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e8308-4f06-40d9-82e8-867e55cd4c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.039112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e8308-4f06-40d9-82e8-867e55cd4c40 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.039585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e8308-4f06-40d9-82e8-867e55cd4c40 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.040047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e8308-4f06-40d9-82e8-867e55cd4c40 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.041046 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e8308-4f06-40d9-82e8-867e55cd4c40 None admin] RBAC: Adding query filter params (name=member) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:02.041632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e8308-4f06-40d9-82e8-867e55cd4c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:02.044544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e8308-4f06-40d9-82e8-867e55cd4c40 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:02.060589 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 82/168] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:02.063223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e8308-4f06-40d9-82e8-867e55cd4c40 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.092018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 87/169] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:02.094027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5237579-83e0-4a67-b1a7-5d4b3d4df580 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.228314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e8308-4f06-40d9-82e8-867e55cd4c40 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.261342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5237579-83e0-4a67-b1a7-5d4b3d4df580 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.273054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6113579-d405-4592-9947-29ef0037c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.274247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6113579-d405-4592-9947-29ef0037c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.274833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6113579-d405-4592-9947-29ef0037c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.275312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6113579-d405-4592-9947-29ef0037c0a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.293464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6113579-d405-4592-9947-29ef0037c0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:02.299631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b39b8-9f8f-45f9-8524-38518993e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.300574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b39b8-9f8f-45f9-8524-38518993e4d4 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.300860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b39b8-9f8f-45f9-8524-38518993e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.301135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b39b8-9f8f-45f9-8524-38518993e4d4 None admin] PATH_INFO: `/v3/users/e49e7be519494a34b3624efb00d6101f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.302541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b39b8-9f8f-45f9-8524-38518993e4d4 None admin] RBAC: Authorizing `identity:get_user(user_id=e49e7be519494a34b3624efb00d6101f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-d6113579-d405-4592-9947-29ef0037c0a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:02.302860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:02.303732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:02.304505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:02.309966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b39b8-9f8f-45f9-8524-38518993e4d4 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:02.309966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 88/170] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/users/e49e7be519494a34b3624efb00d6101f => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:02.309966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b39b8-9f8f-45f9-8524-38518993e4d4 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.311608 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 83/171] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:02.312751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6113579-d405-4592-9947-29ef0037c0a0 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.411029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b39b8-9f8f-45f9-8524-38518993e4d4 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.444870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86d156-e96e-443d-a26b-a58e033c4254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.445781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d156-e96e-443d-a26b-a58e033c4254 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.446065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d156-e96e-443d-a26b-a58e033c4254 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.446337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d156-e96e-443d-a26b-a58e033c4254 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.447540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86d156-e96e-443d-a26b-a58e033c4254 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:02.448992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86d156-e96e-443d-a26b-a58e033c4254 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:02.451028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 89/172] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:02.451490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86d156-e96e-443d-a26b-a58e033c4254 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.460469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6113579-d405-4592-9947-29ef0037c0a0 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.494111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b27902-37c8-4e1b-bd4c-0f9654d5a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.494696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b27902-37c8-4e1b-bd4c-0f9654d5a657 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.494983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b27902-37c8-4e1b-bd4c-0f9654d5a657 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.495265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b27902-37c8-4e1b-bd4c-0f9654d5a657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.551672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86d156-e96e-443d-a26b-a58e033c4254 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.564713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b27902-37c8-4e1b-bd4c-0f9654d5a657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:02.566571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b27902-37c8-4e1b-bd4c-0f9654d5a657 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:02.588336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea79d-e7d4-40f8-a6d0-bdba4d147752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.589044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea79d-e7d4-40f8-a6d0-bdba4d147752 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.589507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea79d-e7d4-40f8-a6d0-bdba4d147752 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.589788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea79d-e7d4-40f8-a6d0-bdba4d147752 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.590557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea79d-e7d4-40f8-a6d0-bdba4d147752 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:02.590862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea79d-e7d4-40f8-a6d0-bdba4d147752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:02.592256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea79d-e7d4-40f8-a6d0-bdba4d147752 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:02.600759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 90/173] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:02.601592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea79d-e7d4-40f8-a6d0-bdba4d147752 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.665911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 84/174] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:02.666725 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b27902-37c8-4e1b-bd4c-0f9654d5a657 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.699861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea79d-e7d4-40f8-a6d0-bdba4d147752 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.732525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db769e50-1a14-4d00-9b85-89de0f11bd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.733235 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769e50-1a14-4d00-9b85-89de0f11bd63 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.733534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769e50-1a14-4d00-9b85-89de0f11bd63 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.733814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769e50-1a14-4d00-9b85-89de0f11bd63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.734681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db769e50-1a14-4d00-9b85-89de0f11bd63 None admin] RBAC: Adding query filter params (role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a, user.id=e49e7be519494a34b3624efb00d6101f) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:02.734994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db769e50-1a14-4d00-9b85-89de0f11bd63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:02.736463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db769e50-1a14-4d00-9b85-89de0f11bd63 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:02.742536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 91/175] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/role_assignments?user.id=e49e7be519494a34b3624efb00d6101f&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=812e67b7a9204b8f925c8e613b2209de => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:02.743278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db769e50-1a14-4d00-9b85-89de0f11bd63 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.767376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b27902-37c8-4e1b-bd4c-0f9654d5a657 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.802255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266f25-0397-4ddb-9e23-2962f256fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.803160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266f25-0397-4ddb-9e23-2962f256fa4b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.803441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266f25-0397-4ddb-9e23-2962f256fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.803715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266f25-0397-4ddb-9e23-2962f256fa4b None admin] PATH_INFO: `/v3/users/21e43441704847e7bde34f8c2e87b4a2` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.805042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266f25-0397-4ddb-9e23-2962f256fa4b None admin] RBAC: Authorizing `identity:get_user(user_id=21e43441704847e7bde34f8c2e87b4a2)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:02.806565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266f25-0397-4ddb-9e23-2962f256fa4b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:02.808644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 85/176] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/users/21e43441704847e7bde34f8c2e87b4a2 => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:02.813645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266f25-0397-4ddb-9e23-2962f256fa4b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.907576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db769e50-1a14-4d00-9b85-89de0f11bd63 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.922410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266f25-0397-4ddb-9e23-2962f256fa4b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:02.957786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa7fd1-8085-4ce5-a54a-40cf68f8f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.958741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7fd1-8085-4ce5-a54a-40cf68f8f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.959021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7fd1-8085-4ce5-a54a-40cf68f8f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.959292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7fd1-8085-4ce5-a54a-40cf68f8f7d3 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.960511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa7fd1-8085-4ce5-a54a-40cf68f8f7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:02.962200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa7fd1-8085-4ce5-a54a-40cf68f8f7d3 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:02.963028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c851b2-214b-4958-8109-cd83853de4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:02.964085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 86/177] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:02.964580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c851b2-214b-4958-8109-cd83853de4e8 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:02.965067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c851b2-214b-4958-8109-cd83853de4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:02.965550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c851b2-214b-4958-8109-cd83853de4e8 None admin] PATH_INFO: `/v3/projects/fb52ce127a3247f4a66f1f717d136c0e` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:02.969138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c851b2-214b-4958-8109-cd83853de4e8 None admin] RBAC: Authorizing `identity:get_project(project_id=fb52ce127a3247f4a66f1f717d136c0e)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:02.969838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa7fd1-8085-4ce5-a54a-40cf68f8f7d3 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:02.971210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c851b2-214b-4958-8109-cd83853de4e8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:02.973514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 92/178] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/projects/fb52ce127a3247f4a66f1f717d136c0e => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:02.978858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c851b2-214b-4958-8109-cd83853de4e8 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:03.073140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa7fd1-8085-4ce5-a54a-40cf68f8f7d3 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:03.109651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f9778-edd2-4a03-bbb4-18b9fd3ef8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:03.110632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9778-edd2-4a03-bbb4-18b9fd3ef8a4 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:03.110846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9778-edd2-4a03-bbb4-18b9fd3ef8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:03.111119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9778-edd2-4a03-bbb4-18b9fd3ef8a4 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/users/21e43441704847e7bde34f8c2e87b4a2/roles/7e055f7884c84073918d471ba5d53247` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:03.113134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c851b2-214b-4958-8109-cd83853de4e8 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:03.113619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f9778-edd2-4a03-bbb4-18b9fd3ef8a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de0bf8f19d4705b1534c7d42f2e99a, user_id=21e43441704847e7bde34f8c2e87b4a2, role_id=7e055f7884c84073918d471ba5d53247)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:03.114799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f9778-edd2-4a03-bbb4-18b9fd3ef8a4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:03.133999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 87/179] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:43:02 2022] PUT /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/users/21e43441704847e7bde34f8c2e87b4a2/roles/7e055f7884c84073918d471ba5d53247 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:03.183261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb8811-3799-4b48-b7d6-573e70507b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:03.184363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb8811-3799-4b48-b7d6-573e70507b54 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:03.184837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb8811-3799-4b48-b7d6-573e70507b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:03.185326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb8811-3799-4b48-b7d6-573e70507b54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:03.186378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb8811-3799-4b48-b7d6-573e70507b54 None admin] RBAC: Adding query filter params (role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=fb52ce127a3247f4a66f1f717d136c0e, user.id=e49e7be519494a34b3624efb00d6101f) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:03.186882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb8811-3799-4b48-b7d6-573e70507b54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:03.188549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb8811-3799-4b48-b7d6-573e70507b54 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:03.198402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 93/180] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:02 2022] GET /identity/v3/role_assignments?user.id=e49e7be519494a34b3624efb00d6101f&scope.project.id=fb52ce127a3247f4a66f1f717d136c0e&role.id=fda329dea4e7408c9791a6554d482329 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:03.332137 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a375aa-752d-427c-9db9-50c4e32ef492 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:03.332628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a375aa-752d-427c-9db9-50c4e32ef492 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:03.332628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a375aa-752d-427c-9db9-50c4e32ef492 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:03.334109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 88/181] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:03.339987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae3b0-e2f6-4ca7-8c24-fb925a92f032 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:03.340485 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae3b0-e2f6-4ca7-8c24-fb925a92f032 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:03.340897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae3b0-e2f6-4ca7-8c24-fb925a92f032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:03.362464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c07ae3b0-e2f6-4ca7-8c24-fb925a92f032 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:03.363741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c07ae3b0-e2f6-4ca7-8c24-fb925a92f032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:03.442638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 94/182] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:03.464888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a375aa-752d-427c-9db9-50c4e32ef492 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:03.587784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a375aa-752d-427c-9db9-50c4e32ef492 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:03.623366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ac05a-c36d-4a48-b8cd-75644853ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:03.624168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ac05a-c36d-4a48-b8cd-75644853ff2e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:03.624450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ac05a-c36d-4a48-b8cd-75644853ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:03.624725 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ac05a-c36d-4a48-b8cd-75644853ff2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:03.635062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ac05a-c36d-4a48-b8cd-75644853ff2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-6d6ac05a-c36d-4a48-b8cd-75644853ff2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:03.642678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:03.643546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:03.644330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 89/183] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:43:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:03.650023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae3b0-e2f6-4ca7-8c24-fb925a92f032 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:03.757257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae3b0-e2f6-4ca7-8c24-fb925a92f032 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:03.794893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c13684-181a-4f02-b926-a9ffd77dd62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:03.795655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c13684-181a-4f02-b926-a9ffd77dd62d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:03.795937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c13684-181a-4f02-b926-a9ffd77dd62d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:03.796212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c13684-181a-4f02-b926-a9ffd77dd62d None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:03.797039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c13684-181a-4f02-b926-a9ffd77dd62d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:03.797371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c13684-181a-4f02-b926-a9ffd77dd62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:03.798806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c13684-181a-4f02-b926-a9ffd77dd62d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:03.808762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 95/184] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:03.814508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ac05a-c36d-4a48-b8cd-75644853ff2e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:03.919077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ac05a-c36d-4a48-b8cd-75644853ff2e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:03.952822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bdfbc-457d-4f2a-a8e0-5e552c45ace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:03.953737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bdfbc-457d-4f2a-a8e0-5e552c45ace4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:03.954022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bdfbc-457d-4f2a-a8e0-5e552c45ace4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:03.954294 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bdfbc-457d-4f2a-a8e0-5e552c45ace4 None admin] PATH_INFO: `/v3/users/121ed507f7db4f82817c7985a9a50a54` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:03.968031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bdfbc-457d-4f2a-a8e0-5e552c45ace4 None admin] RBAC: Authorizing `identity:get_user(user_id=121ed507f7db4f82817c7985a9a50a54)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:03.969539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bdfbc-457d-4f2a-a8e0-5e552c45ace4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:03.971257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 90/185] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:03 2022] GET /identity/v3/users/121ed507f7db4f82817c7985a9a50a54 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:03.977086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c13684-181a-4f02-b926-a9ffd77dd62d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:04.014359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5141a-72d1-43d1-9371-0c5f19b11de2 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.014675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5141a-72d1-43d1-9371-0c5f19b11de2 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.014900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5141a-72d1-43d1-9371-0c5f19b11de2 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.016289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 91/186] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:04.022214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabd243-82f7-44a7-ae8b-7c41d1bf55b7 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.022497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabd243-82f7-44a7-ae8b-7c41d1bf55b7 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.023202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabd243-82f7-44a7-ae8b-7c41d1bf55b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.044471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-aeabd243-82f7-44a7-ae8b-7c41d1bf55b7 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:04.045868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-aeabd243-82f7-44a7-ae8b-7c41d1bf55b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:04.078220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c13684-181a-4f02-b926-a9ffd77dd62d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:04.113249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abb619-df64-436a-98b4-4a59203c055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:04.114058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abb619-df64-436a-98b4-4a59203c055f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.114371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abb619-df64-436a-98b4-4a59203c055f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.114651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abb619-df64-436a-98b4-4a59203c055f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.118524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 92/187] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:04.126804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd055-163e-491f-af34-eefc024b8383 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.127098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd055-163e-491f-af34-eefc024b8383 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.127376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd055-163e-491f-af34-eefc024b8383 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.132895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 93/188] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:04.134070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6daa0-89ad-47e4-8f42-b9235d6ed04a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.134356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6daa0-89ad-47e4-8f42-b9235d6ed04a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.134634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6daa0-89ad-47e4-8f42-b9235d6ed04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.150967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-29d6daa0-89ad-47e4-8f42-b9235d6ed04a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:04.152180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-29d6daa0-89ad-47e4-8f42-b9235d6ed04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:04.185619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abb619-df64-436a-98b4-4a59203c055f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:04.187001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abb619-df64-436a-98b4-4a59203c055f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:04.217597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 94/189] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:04.218838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6daa0-89ad-47e4-8f42-b9235d6ed04a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:04.298374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 96/190] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:04.298374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abb619-df64-436a-98b4-4a59203c055f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:04.328492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6daa0-89ad-47e4-8f42-b9235d6ed04a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:04.366762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676e022-e970-4c1b-922c-92badc94c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:04.367641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676e022-e970-4c1b-922c-92badc94c53d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.367924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676e022-e970-4c1b-922c-92badc94c53d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.368221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676e022-e970-4c1b-922c-92badc94c53d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.369486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676e022-e970-4c1b-922c-92badc94c53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:04.371021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676e022-e970-4c1b-922c-92badc94c53d None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:04.372788 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 95/191] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:04.373563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676e022-e970-4c1b-922c-92badc94c53d None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:04.397741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abb619-df64-436a-98b4-4a59203c055f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:04.436611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7d732-8d69-4032-941f-fb46c5440211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:04.437478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7d732-8d69-4032-941f-fb46c5440211 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.437680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7d732-8d69-4032-941f-fb46c5440211 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.437924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7d732-8d69-4032-941f-fb46c5440211 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.455140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7d732-8d69-4032-941f-fb46c5440211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-9ce7d732-8d69-4032-941f-fb46c5440211 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:04.463356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:04.464224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:04.465010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 97/192] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:04.466370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7d732-8d69-4032-941f-fb46c5440211 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:04.473009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676e022-e970-4c1b-922c-92badc94c53d None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:04.507938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bc354-1ad7-4b1f-a041-88e70ec8579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:04.508840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bc354-1ad7-4b1f-a041-88e70ec8579c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.509113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bc354-1ad7-4b1f-a041-88e70ec8579c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.509411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bc354-1ad7-4b1f-a041-88e70ec8579c None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.510580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bc354-1ad7-4b1f-a041-88e70ec8579c None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:04.512016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bc354-1ad7-4b1f-a041-88e70ec8579c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:04.513744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 96/193] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:04 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:04.519327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bc354-1ad7-4b1f-a041-88e70ec8579c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:04.563299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7d732-8d69-4032-941f-fb46c5440211 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:04.595850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365543-9183-4ca2-bb6e-7c377fdece89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:04.596787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365543-9183-4ca2-bb6e-7c377fdece89 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.597066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365543-9183-4ca2-bb6e-7c377fdece89 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.597502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365543-9183-4ca2-bb6e-7c377fdece89 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.598487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19365543-9183-4ca2-bb6e-7c377fdece89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:04.600019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19365543-9183-4ca2-bb6e-7c377fdece89 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:04.611955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bc354-1ad7-4b1f-a041-88e70ec8579c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:04.633721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 98/194] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:43:04 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:43:04.633721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365543-9183-4ca2-bb6e-7c377fdece89 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:04.667396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2c435-9a5b-4724-adf3-aab9819d1bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:04.668192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c435-9a5b-4724-adf3-aab9819d1bfc None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.668476 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c435-9a5b-4724-adf3-aab9819d1bfc None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.668932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c435-9a5b-4724-adf3-aab9819d1bfc None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.670673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c435-9a5b-4724-adf3-aab9819d1bfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:04.670991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c435-9a5b-4724-adf3-aab9819d1bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:04.672474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c435-9a5b-4724-adf3-aab9819d1bfc None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:04.688760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 97/195] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:04.690270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2c435-9a5b-4724-adf3-aab9819d1bfc None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:04.748053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365543-9183-4ca2-bb6e-7c377fdece89 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:04.785038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b14f3-de69-4a93-87ef-892216c998bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:04.785779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b14f3-de69-4a93-87ef-892216c998bb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.786067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b14f3-de69-4a93-87ef-892216c998bb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.786415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b14f3-de69-4a93-87ef-892216c998bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.787275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b14f3-de69-4a93-87ef-892216c998bb None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f, user.id=121ed507f7db4f82817c7985a9a50a54) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:04.787593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b14f3-de69-4a93-87ef-892216c998bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:04.789127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b14f3-de69-4a93-87ef-892216c998bb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:04.795351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 99/196] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:04 2022] GET /identity/v3/role_assignments?user.id=121ed507f7db4f82817c7985a9a50a54&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:04.801320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2c435-9a5b-4724-adf3-aab9819d1bfc None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:04.840228 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58701d69-2dc2-40a4-8f7c-4e30555a08ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:04.841134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58701d69-2dc2-40a4-8f7c-4e30555a08ac None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.841450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58701d69-2dc2-40a4-8f7c-4e30555a08ac None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.841722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58701d69-2dc2-40a4-8f7c-4e30555a08ac None admin] PATH_INFO: `/v3/users/121ed507f7db4f82817c7985a9a50a54` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:04.842993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58701d69-2dc2-40a4-8f7c-4e30555a08ac None admin] RBAC: Authorizing `identity:get_user(user_id=121ed507f7db4f82817c7985a9a50a54)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:04.844480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58701d69-2dc2-40a4-8f7c-4e30555a08ac None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:04.846391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 98/197] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:04 2022] GET /identity/v3/users/121ed507f7db4f82817c7985a9a50a54 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:04.851960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b14f3-de69-4a93-87ef-892216c998bb None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:04.959982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b14f3-de69-4a93-87ef-892216c998bb None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:04.995596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114257d7-1b49-409d-8c97-940d5b6c3535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:04.996310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114257d7-1b49-409d-8c97-940d5b6c3535 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:04.996590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114257d7-1b49-409d-8c97-940d5b6c3535 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:04.996862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114257d7-1b49-409d-8c97-940d5b6c3535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:05.063491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114257d7-1b49-409d-8c97-940d5b6c3535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:05.064940 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114257d7-1b49-409d-8c97-940d5b6c3535 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:05.163993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 100/198] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:05.169300 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58701d69-2dc2-40a4-8f7c-4e30555a08ac None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:05.279195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58701d69-2dc2-40a4-8f7c-4e30555a08ac None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:05.316975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec80c3-cdcc-4130-b24d-140ce04cdac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:05.317912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec80c3-cdcc-4130-b24d-140ce04cdac1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:05.318192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec80c3-cdcc-4130-b24d-140ce04cdac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:05.318463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec80c3-cdcc-4130-b24d-140ce04cdac1 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:05.322007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec80c3-cdcc-4130-b24d-140ce04cdac1 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:05.323477 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec80c3-cdcc-4130-b24d-140ce04cdac1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:05.325188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 99/199] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:05 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:05.332950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114257d7-1b49-409d-8c97-940d5b6c3535 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:05.463431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114257d7-1b49-409d-8c97-940d5b6c3535 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:05.496962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa4c72-c066-4cc9-94ec-09962beedfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:05.497669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4c72-c066-4cc9-94ec-09962beedfa9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:05.497954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4c72-c066-4cc9-94ec-09962beedfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:05.498268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4c72-c066-4cc9-94ec-09962beedfa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:05.499119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa4c72-c066-4cc9-94ec-09962beedfa9 None admin] RBAC: Adding query filter params (role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f, user.id=121ed507f7db4f82817c7985a9a50a54) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:05.499433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa4c72-c066-4cc9-94ec-09962beedfa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:05.501187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa4c72-c066-4cc9-94ec-09962beedfa9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:05.507087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 101/200] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:05 2022] GET /identity/v3/role_assignments?user.id=121ed507f7db4f82817c7985a9a50a54&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=812e67b7a9204b8f925c8e613b2209de => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:05.656197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dca98-3d39-437e-84c5-52f2e7d7c8a9 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:05.656719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dca98-3d39-437e-84c5-52f2e7d7c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:05.656719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dca98-3d39-437e-84c5-52f2e7d7c8a9 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:05.658382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 100/201] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:05.671153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b8eb-662d-47d2-a9d6-74bc02ad1225 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:05.671490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b8eb-662d-47d2-a9d6-74bc02ad1225 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:05.671723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b8eb-662d-47d2-a9d6-74bc02ad1225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:05.698225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-70d1b8eb-662d-47d2-a9d6-74bc02ad1225 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:05.699445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-70d1b8eb-662d-47d2-a9d6-74bc02ad1225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:05.777405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 102/202] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:05.801959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dca98-3d39-437e-84c5-52f2e7d7c8a9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:05.925208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dca98-3d39-437e-84c5-52f2e7d7c8a9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:05.969996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4326-e51d-44d1-b561-3c01d21406c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:05.970873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4326-e51d-44d1-b561-3c01d21406c2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:05.971151 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4326-e51d-44d1-b561-3c01d21406c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:05.971421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4326-e51d-44d1-b561-3c01d21406c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:05.983868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df4326-e51d-44d1-b561-3c01d21406c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-c8df4326-e51d-44d1-b561-3c01d21406c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:05.991689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:05.992586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:05.994025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 101/203] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:05.998796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1b8eb-662d-47d2-a9d6-74bc02ad1225 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:06.125196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1b8eb-662d-47d2-a9d6-74bc02ad1225 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:06.159669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b874-80ba-4ad7-9eed-0cb7844ff49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:06.160352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b874-80ba-4ad7-9eed-0cb7844ff49a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:06.160636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b874-80ba-4ad7-9eed-0cb7844ff49a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:06.160909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b874-80ba-4ad7-9eed-0cb7844ff49a None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:06.161729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96b874-80ba-4ad7-9eed-0cb7844ff49a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:06.162034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96b874-80ba-4ad7-9eed-0cb7844ff49a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:06.163421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96b874-80ba-4ad7-9eed-0cb7844ff49a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:06.172138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 103/204] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:06.177820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4326-e51d-44d1-b561-3c01d21406c2 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:06.348289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4326-e51d-44d1-b561-3c01d21406c2 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:06.397275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f247f4f-e11f-445a-ab11-c19056f79fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:06.398173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247f4f-e11f-445a-ab11-c19056f79fa1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:06.398451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247f4f-e11f-445a-ab11-c19056f79fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:06.398723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247f4f-e11f-445a-ab11-c19056f79fa1 None admin] PATH_INFO: `/v3/users/21e43441704847e7bde34f8c2e87b4a2` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:06.405980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f247f4f-e11f-445a-ab11-c19056f79fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=21e43441704847e7bde34f8c2e87b4a2)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:06.407445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f247f4f-e11f-445a-ab11-c19056f79fa1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:06.409394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 102/205] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:06 2022] GET /identity/v3/users/21e43441704847e7bde34f8c2e87b4a2 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:06.414615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b874-80ba-4ad7-9eed-0cb7844ff49a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:06.529150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b874-80ba-4ad7-9eed-0cb7844ff49a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:06.562024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4c52d-ef51-40b2-a0f6-00e830382947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:06.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4c52d-ef51-40b2-a0f6-00e830382947 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:06.562967 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4c52d-ef51-40b2-a0f6-00e830382947 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:06.563242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4c52d-ef51-40b2-a0f6-00e830382947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:06.631450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4c52d-ef51-40b2-a0f6-00e830382947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:06.632965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4c52d-ef51-40b2-a0f6-00e830382947 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:06.730639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 104/206] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:06.736219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f247f4f-e11f-445a-ab11-c19056f79fa1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:06.883505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f247f4f-e11f-445a-ab11-c19056f79fa1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:06.920726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1dc0a-bced-46d9-9357-b5f79a87a1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:06.921637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1dc0a-bced-46d9-9357-b5f79a87a1bc None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:06.921921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1dc0a-bced-46d9-9357-b5f79a87a1bc None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:06.922196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1dc0a-bced-46d9-9357-b5f79a87a1bc None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:06.923403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1dc0a-bced-46d9-9357-b5f79a87a1bc None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:06.924854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1dc0a-bced-46d9-9357-b5f79a87a1bc None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:06.926949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 103/207] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:06 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:06.932604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4c52d-ef51-40b2-a0f6-00e830382947 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:07.104996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4c52d-ef51-40b2-a0f6-00e830382947 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:07.148789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b942a26-73d9-4b7b-a0c6-f1c5889d3414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:07.149844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942a26-73d9-4b7b-a0c6-f1c5889d3414 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:07.150338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942a26-73d9-4b7b-a0c6-f1c5889d3414 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:07.150795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942a26-73d9-4b7b-a0c6-f1c5889d3414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:07.151827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b942a26-73d9-4b7b-a0c6-f1c5889d3414 None admin] RBAC: Adding query filter params (role.id=7e055f7884c84073918d471ba5d53247, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a, user.id=21e43441704847e7bde34f8c2e87b4a2) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:07.152344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b942a26-73d9-4b7b-a0c6-f1c5889d3414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:07.153983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b942a26-73d9-4b7b-a0c6-f1c5889d3414 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:07.163100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 105/208] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:06 2022] GET /identity/v3/role_assignments?user.id=21e43441704847e7bde34f8c2e87b4a2&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=7e055f7884c84073918d471ba5d53247 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:07.510691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3e7c-25ca-47cd-b38e-5ab97f7f8f0c None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:07.511361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3e7c-25ca-47cd-b38e-5ab97f7f8f0c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:07.511834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3e7c-25ca-47cd-b38e-5ab97f7f8f0c None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:07.513935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 104/209] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:07.519669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cd553-04dc-4d34-9544-af8f57f6f1e5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:07.520650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cd553-04dc-4d34-9544-af8f57f6f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:07.521120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cd553-04dc-4d34-9544-af8f57f6f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:07.542308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-000cd553-04dc-4d34-9544-af8f57f6f1e5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:07.543837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-000cd553-04dc-4d34-9544-af8f57f6f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:07.617532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 106/210] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:07.643662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3e7c-25ca-47cd-b38e-5ab97f7f8f0c None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:07.649190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd1900-fccd-41db-95dd-1f43af005365 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:07.649518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd1900-fccd-41db-95dd-1f43af005365 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:07.649798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd1900-fccd-41db-95dd-1f43af005365 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:07.651311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 107/211] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:07.656695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d39b0-fa08-4fbb-af57-225e7f49db80 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:07.656977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d39b0-fa08-4fbb-af57-225e7f49db80 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:07.657250 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d39b0-fa08-4fbb-af57-225e7f49db80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:07.681180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-789d39b0-fa08-4fbb-af57-225e7f49db80 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:07.682786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-789d39b0-fa08-4fbb-af57-225e7f49db80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:07.750730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 108/212] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:07.752332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cdb04-18e9-4060-befa-0df255097375 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:07.752618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cdb04-18e9-4060-befa-0df255097375 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:07.752915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cdb04-18e9-4060-befa-0df255097375 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:07.758633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 109/213] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:07.762863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3e7c-25ca-47cd-b38e-5ab97f7f8f0c None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:07.763549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416aa32-09f0-4467-ad37-5ac75120c177 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:07.763986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416aa32-09f0-4467-ad37-5ac75120c177 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:07.764403 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416aa32-09f0-4467-ad37-5ac75120c177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:07.781783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6416aa32-09f0-4467-ad37-5ac75120c177 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:07.783172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6416aa32-09f0-4467-ad37-5ac75120c177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:07.797966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711368f2-14ba-4ea3-ade4-60666d5af10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:07.798775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711368f2-14ba-4ea3-ade4-60666d5af10f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:07.799059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711368f2-14ba-4ea3-ade4-60666d5af10f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:07.799337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711368f2-14ba-4ea3-ade4-60666d5af10f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:07.809575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711368f2-14ba-4ea3-ade4-60666d5af10f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-711368f2-14ba-4ea3-ade4-60666d5af10f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:07.817471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:07.818379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:07.819181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 105/214] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:07.819850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711368f2-14ba-4ea3-ade4-60666d5af10f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:07.858954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 110/215] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:07.860142 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416aa32-09f0-4467-ad37-5ac75120c177 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:07.928425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711368f2-14ba-4ea3-ade4-60666d5af10f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:07.960069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee163222-e103-457c-84af-d3ef0d294361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:07.960862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163222-e103-457c-84af-d3ef0d294361 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:07.961137 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163222-e103-457c-84af-d3ef0d294361 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:07.961462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163222-e103-457c-84af-d3ef0d294361 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:07.966432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416aa32-09f0-4467-ad37-5ac75120c177 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:07.971364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee163222-e103-457c-84af-d3ef0d294361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-ee163222-e103-457c-84af-d3ef0d294361 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:07.978990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:07.979861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:07.980658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 106/216] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:07.981325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee163222-e103-457c-84af-d3ef0d294361 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.006336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fd20a-9217-4f61-bdda-1dcdb7c7c60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.007193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fd20a-9217-4f61-bdda-1dcdb7c7c60a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.007472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fd20a-9217-4f61-bdda-1dcdb7c7c60a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.007880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fd20a-9217-4f61-bdda-1dcdb7c7c60a None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.008929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fd20a-9217-4f61-bdda-1dcdb7c7c60a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:08.009396 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fd20a-9217-4f61-bdda-1dcdb7c7c60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.011044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fd20a-9217-4f61-bdda-1dcdb7c7c60a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.020352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 111/217] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:08.021453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fd20a-9217-4f61-bdda-1dcdb7c7c60a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.078748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee163222-e103-457c-84af-d3ef0d294361 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.110584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557cb1a-c395-4a80-b4ed-95e774b9c62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.111409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557cb1a-c395-4a80-b4ed-95e774b9c62b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.111691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557cb1a-c395-4a80-b4ed-95e774b9c62b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.111947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557cb1a-c395-4a80-b4ed-95e774b9c62b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.113204 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557cb1a-c395-4a80-b4ed-95e774b9c62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.114302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fd20a-9217-4f61-bdda-1dcdb7c7c60a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.114788 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557cb1a-c395-4a80-b4ed-95e774b9c62b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.121643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 107/218] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:08.121643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557cb1a-c395-4a80-b4ed-95e774b9c62b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.150810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80fe67-d4a3-4757-9e6d-4678c5a6f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.151882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80fe67-d4a3-4757-9e6d-4678c5a6f52a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.152375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80fe67-d4a3-4757-9e6d-4678c5a6f52a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.152782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80fe67-d4a3-4757-9e6d-4678c5a6f52a None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.153706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80fe67-d4a3-4757-9e6d-4678c5a6f52a None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:08.154147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80fe67-d4a3-4757-9e6d-4678c5a6f52a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.155651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80fe67-d4a3-4757-9e6d-4678c5a6f52a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.164437 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 112/219] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:08.165472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80fe67-d4a3-4757-9e6d-4678c5a6f52a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.225277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557cb1a-c395-4a80-b4ed-95e774b9c62b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.258079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65d81f-fa2d-432d-a6ed-8bc7ea08900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.258890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65d81f-fa2d-432d-a6ed-8bc7ea08900a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.259175 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65d81f-fa2d-432d-a6ed-8bc7ea08900a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.259447 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65d81f-fa2d-432d-a6ed-8bc7ea08900a None admin] PATH_INFO: `/v3/users/121ed507f7db4f82817c7985a9a50a54` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.260631 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65d81f-fa2d-432d-a6ed-8bc7ea08900a None admin] RBAC: Authorizing `identity:get_user(user_id=121ed507f7db4f82817c7985a9a50a54)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.262119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65d81f-fa2d-432d-a6ed-8bc7ea08900a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.263747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 108/220] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:08 2022] GET /identity/v3/users/121ed507f7db4f82817c7985a9a50a54 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:08.264500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65d81f-fa2d-432d-a6ed-8bc7ea08900a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.271428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80fe67-d4a3-4757-9e6d-4678c5a6f52a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.305494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043314f-5406-4081-93c1-705eaa24eef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.306177 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043314f-5406-4081-93c1-705eaa24eef8 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.306457 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043314f-5406-4081-93c1-705eaa24eef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.306730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043314f-5406-4081-93c1-705eaa24eef8 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.307467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043314f-5406-4081-93c1-705eaa24eef8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.308906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043314f-5406-4081-93c1-705eaa24eef8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.327927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 113/221] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:43:08 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:43:08.328939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043314f-5406-4081-93c1-705eaa24eef8 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.364365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65d81f-fa2d-432d-a6ed-8bc7ea08900a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.398622 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee849f31-2103-47e5-8abe-0606f85dab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.399520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee849f31-2103-47e5-8abe-0606f85dab34 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.399801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee849f31-2103-47e5-8abe-0606f85dab34 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.400079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee849f31-2103-47e5-8abe-0606f85dab34 None admin] PATH_INFO: `/v3/users/fa31d9a3b8ee48199d40a6edbbd37781` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.414332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee849f31-2103-47e5-8abe-0606f85dab34 None admin] RBAC: Authorizing `identity:get_user(user_id=fa31d9a3b8ee48199d40a6edbbd37781)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.415807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee849f31-2103-47e5-8abe-0606f85dab34 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.422452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 109/222] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:08 2022] GET /identity/v3/users/fa31d9a3b8ee48199d40a6edbbd37781 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:08.422452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f2008-ba46-4691-8e47-0569e413f049 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.422452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f2008-ba46-4691-8e47-0569e413f049 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.422452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f2008-ba46-4691-8e47-0569e413f049 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.422452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 110/223] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:08.426315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f2008-ba46-4691-8e47-0569e413f049 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.434742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043314f-5406-4081-93c1-705eaa24eef8 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.468138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650a1c-69cf-4919-b860-7c00faecc617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.469022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650a1c-69cf-4919-b860-7c00faecc617 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.469381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650a1c-69cf-4919-b860-7c00faecc617 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.469596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650a1c-69cf-4919-b860-7c00faecc617 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.470842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650a1c-69cf-4919-b860-7c00faecc617 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.472336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650a1c-69cf-4919-b860-7c00faecc617 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.474381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 114/224] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:08 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:08.475437 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6a58-5c38-44df-8df6-1666020ca416 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.475717 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6a58-5c38-44df-8df6-1666020ca416 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.475990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6a58-5c38-44df-8df6-1666020ca416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.492895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-8f2f6a58-5c38-44df-8df6-1666020ca416 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:08.494159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8f2f6a58-5c38-44df-8df6-1666020ca416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:08.534127 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f2008-ba46-4691-8e47-0569e413f049 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.561743 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 115/225] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:08.562980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6a58-5c38-44df-8df6-1666020ca416 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.569490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817d112-4456-4c4f-b267-497f3f55ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.570409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817d112-4456-4c4f-b267-497f3f55ac14 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.570888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817d112-4456-4c4f-b267-497f3f55ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.571356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817d112-4456-4c4f-b267-497f3f55ac14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.643894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817d112-4456-4c4f-b267-497f3f55ac14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.645425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817d112-4456-4c4f-b267-497f3f55ac14 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.663135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6a58-5c38-44df-8df6-1666020ca416 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.695645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb546517-f622-4723-abd7-20e2d32ee7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.696539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb546517-f622-4723-abd7-20e2d32ee7e9 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.696814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb546517-f622-4723-abd7-20e2d32ee7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.697085 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb546517-f622-4723-abd7-20e2d32ee7e9 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/users/121ed507f7db4f82817c7985a9a50a54/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.699686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb546517-f622-4723-abd7-20e2d32ee7e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6737563b3a84f8385cbad6b6c06f54f, user_id=121ed507f7db4f82817c7985a9a50a54, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.701146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb546517-f622-4723-abd7-20e2d32ee7e9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.715152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 116/226] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:43:08 2022] PUT /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/users/121ed507f7db4f82817c7985a9a50a54/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:08.715753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb546517-f622-4723-abd7-20e2d32ee7e9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.763761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 111/227] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:08.769740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817d112-4456-4c4f-b267-497f3f55ac14 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.821033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb546517-f622-4723-abd7-20e2d32ee7e9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.855531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9dc9-33e0-4e2a-9ffb-8f9ad5cd8662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.856348 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9dc9-33e0-4e2a-9ffb-8f9ad5cd8662 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.856622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9dc9-33e0-4e2a-9ffb-8f9ad5cd8662 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.856891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9dc9-33e0-4e2a-9ffb-8f9ad5cd8662 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.867400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9dc9-33e0-4e2a-9ffb-8f9ad5cd8662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:08.872796 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817d112-4456-4c4f-b267-497f3f55ac14 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a03e9dc9-33e0-4e2a-9ffb-8f9ad5cd8662 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:08.875799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:08.876724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:08.877576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 117/228] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:08.882922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9dc9-33e0-4e2a-9ffb-8f9ad5cd8662 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.908089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da3b64-4076-42ba-862a-d18432f5f44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:08.908973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da3b64-4076-42ba-862a-d18432f5f44a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:08.909250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da3b64-4076-42ba-862a-d18432f5f44a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:08.909546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da3b64-4076-42ba-862a-d18432f5f44a None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:08.910723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da3b64-4076-42ba-862a-d18432f5f44a None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:08.912200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da3b64-4076-42ba-862a-d18432f5f44a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:08.918813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 112/229] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:08 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:08.920111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da3b64-4076-42ba-862a-d18432f5f44a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:08.981622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9dc9-33e0-4e2a-9ffb-8f9ad5cd8662 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:09.015328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91102dd-8b07-48dd-81c8-c8d1b6c13700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:09.015680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91102dd-8b07-48dd-81c8-c8d1b6c13700 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:09.015864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91102dd-8b07-48dd-81c8-c8d1b6c13700 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:09.016133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91102dd-8b07-48dd-81c8-c8d1b6c13700 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:09.016887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91102dd-8b07-48dd-81c8-c8d1b6c13700 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:09.017195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91102dd-8b07-48dd-81c8-c8d1b6c13700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:09.018782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91102dd-8b07-48dd-81c8-c8d1b6c13700 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:09.019543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da3b64-4076-42ba-862a-d18432f5f44a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:09.026851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 118/230] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:09.032355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91102dd-8b07-48dd-81c8-c8d1b6c13700 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:09.054383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a4009-5625-4dfc-a919-00e3ee09e417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:09.055045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a4009-5625-4dfc-a919-00e3ee09e417 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:09.055322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a4009-5625-4dfc-a919-00e3ee09e417 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:09.055599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a4009-5625-4dfc-a919-00e3ee09e417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:09.056435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a4009-5625-4dfc-a919-00e3ee09e417 None admin] RBAC: Adding query filter params (role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f, user.id=fa31d9a3b8ee48199d40a6edbbd37781) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:09.056794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a4009-5625-4dfc-a919-00e3ee09e417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:09.058337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a4009-5625-4dfc-a919-00e3ee09e417 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:09.069462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 113/231] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:08 2022] GET /identity/v3/role_assignments?user.id=fa31d9a3b8ee48199d40a6edbbd37781&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=fda329dea4e7408c9791a6554d482329 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:09.133877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91102dd-8b07-48dd-81c8-c8d1b6c13700 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:09.168834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaf692-023f-49a2-ba28-c1466dd2733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:09.169762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaf692-023f-49a2-ba28-c1466dd2733f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:09.170038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaf692-023f-49a2-ba28-c1466dd2733f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:09.170310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaf692-023f-49a2-ba28-c1466dd2733f None admin] PATH_INFO: `/v3/users/121ed507f7db4f82817c7985a9a50a54` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:09.171553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaf692-023f-49a2-ba28-c1466dd2733f None admin] RBAC: Authorizing `identity:get_user(user_id=121ed507f7db4f82817c7985a9a50a54)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:09.173008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaf692-023f-49a2-ba28-c1466dd2733f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:09.175029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 119/232] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:09 2022] GET /identity/v3/users/121ed507f7db4f82817c7985a9a50a54 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:09.180914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a4009-5625-4dfc-a919-00e3ee09e417 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:09.306933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a4009-5625-4dfc-a919-00e3ee09e417 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:09.340826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b581a75-9137-4943-a9f1-5dc8693c4621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:09.341799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581a75-9137-4943-a9f1-5dc8693c4621 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:09.342079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581a75-9137-4943-a9f1-5dc8693c4621 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:09.342350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581a75-9137-4943-a9f1-5dc8693c4621 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:09.343520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b581a75-9137-4943-a9f1-5dc8693c4621 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:09.344952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b581a75-9137-4943-a9f1-5dc8693c4621 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:09.346955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 114/233] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:09 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:09.352866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaf692-023f-49a2-ba28-c1466dd2733f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:09.463680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaf692-023f-49a2-ba28-c1466dd2733f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:09.496236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18be1f-344e-4210-af77-483bd8a3d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:09.497131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18be1f-344e-4210-af77-483bd8a3d1f9 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:09.497435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18be1f-344e-4210-af77-483bd8a3d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:09.497702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18be1f-344e-4210-af77-483bd8a3d1f9 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/users/121ed507f7db4f82817c7985a9a50a54/roles/812e67b7a9204b8f925c8e613b2209de` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:09.500251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18be1f-344e-4210-af77-483bd8a3d1f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6737563b3a84f8385cbad6b6c06f54f, user_id=121ed507f7db4f82817c7985a9a50a54, role_id=812e67b7a9204b8f925c8e613b2209de)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:09.501764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18be1f-344e-4210-af77-483bd8a3d1f9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:09.518688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 120/234] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:43:09 2022] PUT /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/users/121ed507f7db4f82817c7985a9a50a54/roles/812e67b7a9204b8f925c8e613b2209de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:11.105526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3f53-3f64-42e1-9c43-341c90411958 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.106238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3f53-3f64-42e1-9c43-341c90411958 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.106238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3f53-3f64-42e1-9c43-341c90411958 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.107423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 115/235] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:11.120654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32168bef-cde0-4792-8f40-8f34cf7ee9e0 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.121260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32168bef-cde0-4792-8f40-8f34cf7ee9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.121260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32168bef-cde0-4792-8f40-8f34cf7ee9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.142430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-32168bef-cde0-4792-8f40-8f34cf7ee9e0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:11.143609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-32168bef-cde0-4792-8f40-8f34cf7ee9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:11.219752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda1189-77e3-409d-9477-145570534be5 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.219752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda1189-77e3-409d-9477-145570534be5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.219752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda1189-77e3-409d-9477-145570534be5 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.219752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 116/236] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:11.226646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6fb66-7702-40c4-af67-aa474c8cfedf None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.226646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6fb66-7702-40c4-af67-aa474c8cfedf None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.226646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6fb66-7702-40c4-af67-aa474c8cfedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.226946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 121/237] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:11.266605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-92f6fb66-7702-40c4-af67-aa474c8cfedf None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:11.267883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-92f6fb66-7702-40c4-af67-aa474c8cfedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:11.276751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32168bef-cde0-4792-8f40-8f34cf7ee9e0 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:11.384000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 117/238] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:11.410419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6fb66-7702-40c4-af67-aa474c8cfedf None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:11.457456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32168bef-cde0-4792-8f40-8f34cf7ee9e0 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:11.535172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6fb66-7702-40c4-af67-aa474c8cfedf None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:11.542465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4405e-f486-46f8-a988-a2a8c6d07b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:11.543321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4405e-f486-46f8-a988-a2a8c6d07b93 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.543594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4405e-f486-46f8-a988-a2a8c6d07b93 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.543860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4405e-f486-46f8-a988-a2a8c6d07b93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.550006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4405e-f486-46f8-a988-a2a8c6d07b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:11.551476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4405e-f486-46f8-a988-a2a8c6d07b93 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:11.553464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 122/239] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:11.559190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4405e-f486-46f8-a988-a2a8c6d07b93 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:11.578038 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170f829-e366-4f15-9350-d5b6d0104223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:11.578853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170f829-e366-4f15-9350-d5b6d0104223 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.579128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170f829-e366-4f15-9350-d5b6d0104223 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.579396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170f829-e366-4f15-9350-d5b6d0104223 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.591605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170f829-e366-4f15-9350-d5b6d0104223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-d170f829-e366-4f15-9350-d5b6d0104223 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:11.599467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:11.600367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:11.601162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 118/240] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:11.606772 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170f829-e366-4f15-9350-d5b6d0104223 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:11.690032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4405e-f486-46f8-a988-a2a8c6d07b93 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:11.731625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef0380-4218-4aba-8db4-f13f9e080fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:11.732316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0380-4218-4aba-8db4-f13f9e080fa0 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.732758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0380-4218-4aba-8db4-f13f9e080fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.733034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0380-4218-4aba-8db4-f13f9e080fa0 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.734389 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef0380-4218-4aba-8db4-f13f9e080fa0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:11.736381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef0380-4218-4aba-8db4-f13f9e080fa0 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:11.767015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 123/241] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:43:11 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:43:11.768510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b26a6-d001-4cff-a9c2-93f072829733 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.768801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b26a6-d001-4cff-a9c2-93f072829733 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.769077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b26a6-d001-4cff-a9c2-93f072829733 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.770687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 124/242] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:11.777589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581181c-aedd-40d6-9479-42c9022c7aad None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.777903 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581181c-aedd-40d6-9479-42c9022c7aad None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.778634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581181c-aedd-40d6-9479-42c9022c7aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.799417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e581181c-aedd-40d6-9479-42c9022c7aad None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:11.801308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e581181c-aedd-40d6-9479-42c9022c7aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:11.803712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170f829-e366-4f15-9350-d5b6d0104223 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:11.863018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5459-eb6f-4fba-8a4d-9e6652d28b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:11.863775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5459-eb6f-4fba-8a4d-9e6652d28b67 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:11.864087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5459-eb6f-4fba-8a4d-9e6652d28b67 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:11.864476 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5459-eb6f-4fba-8a4d-9e6652d28b67 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:11.865238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e5459-eb6f-4fba-8a4d-9e6652d28b67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:11.865567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e5459-eb6f-4fba-8a4d-9e6652d28b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:11.866994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e5459-eb6f-4fba-8a4d-9e6652d28b67 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:11.886086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 125/243] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:11.896044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 119/244] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:11.901673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581181c-aedd-40d6-9479-42c9022c7aad None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:11.916336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5459-eb6f-4fba-8a4d-9e6652d28b67 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.030100 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5459-eb6f-4fba-8a4d-9e6652d28b67 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.038497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581181c-aedd-40d6-9479-42c9022c7aad None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.069615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625293a-d9cc-4458-8665-052216dfe222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.070430 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625293a-d9cc-4458-8665-052216dfe222 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.070708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625293a-d9cc-4458-8665-052216dfe222 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.070977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625293a-d9cc-4458-8665-052216dfe222 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.079744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22c839-e909-4b4f-9169-a7a681a3e90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.080622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22c839-e909-4b4f-9169-a7a681a3e90d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.080907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22c839-e909-4b4f-9169-a7a681a3e90d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.081204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22c839-e909-4b4f-9169-a7a681a3e90d None admin] PATH_INFO: `/v3/users/64b1f889ee7b4d96b8ceeacce4acaf64` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.082609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625293a-d9cc-4458-8665-052216dfe222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-d625293a-d9cc-4458-8665-052216dfe222 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:12.090323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:12.092833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 120/245] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:43:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:12.094797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab00bc-6763-4bf7-ac21-20842dd639bb None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.096513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab00bc-6763-4bf7-ac21-20842dd639bb None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.096513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab00bc-6763-4bf7-ac21-20842dd639bb None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.096513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 121/246] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:12.097076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab00bc-6763-4bf7-ac21-20842dd639bb None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.106914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22c839-e909-4b4f-9169-a7a681a3e90d None admin] RBAC: Authorizing `identity:get_user(user_id=64b1f889ee7b4d96b8ceeacce4acaf64)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:12.108732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22c839-e909-4b4f-9169-a7a681a3e90d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:12.111821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 126/247] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:11 2022] GET /identity/v3/users/64b1f889ee7b4d96b8ceeacce4acaf64 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:12.112950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e6fe2-feb3-4237-805f-de08fd18bc82 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.113947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e6fe2-feb3-4237-805f-de08fd18bc82 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.113947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e6fe2-feb3-4237-805f-de08fd18bc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.130345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-709e6fe2-feb3-4237-805f-de08fd18bc82 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:12.131781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-709e6fe2-feb3-4237-805f-de08fd18bc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:12.204121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab00bc-6763-4bf7-ac21-20842dd639bb None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.205394 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 127/248] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:12.206614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e6fe2-feb3-4237-805f-de08fd18bc82 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.241693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb9177-c785-4b3a-9b33-8bb703fd75c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.242728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb9177-c785-4b3a-9b33-8bb703fd75c7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.243207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb9177-c785-4b3a-9b33-8bb703fd75c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.243806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb9177-c785-4b3a-9b33-8bb703fd75c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.245631 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb9177-c785-4b3a-9b33-8bb703fd75c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:12.246192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb9177-c785-4b3a-9b33-8bb703fd75c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:12.247805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb9177-c785-4b3a-9b33-8bb703fd75c7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:12.260762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 122/249] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:12.262249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb9177-c785-4b3a-9b33-8bb703fd75c7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.338719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e6fe2-feb3-4237-805f-de08fd18bc82 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.376173 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3cbd0-2d17-46e7-b70f-b09fb2b9f727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.377179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3cbd0-2d17-46e7-b70f-b09fb2b9f727 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.377682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3cbd0-2d17-46e7-b70f-b09fb2b9f727 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.378149 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3cbd0-2d17-46e7-b70f-b09fb2b9f727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.390544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb9177-c785-4b3a-9b33-8bb703fd75c7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.439916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a42960-1ab4-454c-972f-cdf90ca4d161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.441158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42960-1ab4-454c-972f-cdf90ca4d161 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.443039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42960-1ab4-454c-972f-cdf90ca4d161 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.443556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42960-1ab4-454c-972f-cdf90ca4d161 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.462853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3cbd0-2d17-46e7-b70f-b09fb2b9f727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:12.466341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3cbd0-2d17-46e7-b70f-b09fb2b9f727 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:12.467683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a42960-1ab4-454c-972f-cdf90ca4d161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-92a42960-1ab4-454c-972f-cdf90ca4d161 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:12.482342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:12.483275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:12.484057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 123/250] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:12.484720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a42960-1ab4-454c-972f-cdf90ca4d161 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.575780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 128/251] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:12.576628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3cbd0-2d17-46e7-b70f-b09fb2b9f727 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.591859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a42960-1ab4-454c-972f-cdf90ca4d161 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.627500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52d23a-b52a-4a3e-8c87-9611aad8fab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.628412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52d23a-b52a-4a3e-8c87-9611aad8fab3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.628695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52d23a-b52a-4a3e-8c87-9611aad8fab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.628970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52d23a-b52a-4a3e-8c87-9611aad8fab3 None admin] PATH_INFO: `/v3/users/121ed507f7db4f82817c7985a9a50a54` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.630224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52d23a-b52a-4a3e-8c87-9611aad8fab3 None admin] RBAC: Authorizing `identity:get_user(user_id=121ed507f7db4f82817c7985a9a50a54)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:12.631683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52d23a-b52a-4a3e-8c87-9611aad8fab3 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:12.633672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 124/252] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:12 2022] GET /identity/v3/users/121ed507f7db4f82817c7985a9a50a54 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:12.634965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f612080-6671-42db-9bf1-bb607f76bf61 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.635249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f612080-6671-42db-9bf1-bb607f76bf61 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.635522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f612080-6671-42db-9bf1-bb607f76bf61 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.636725 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 125/253] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:12.637920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f612080-6671-42db-9bf1-bb607f76bf61 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.673592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3cbd0-2d17-46e7-b70f-b09fb2b9f727 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.706616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876689f5-91d9-4f06-8f1f-82bdc9ddda2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.707290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876689f5-91d9-4f06-8f1f-82bdc9ddda2a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.707572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876689f5-91d9-4f06-8f1f-82bdc9ddda2a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.707871 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876689f5-91d9-4f06-8f1f-82bdc9ddda2a None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.708665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876689f5-91d9-4f06-8f1f-82bdc9ddda2a None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:12.708973 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876689f5-91d9-4f06-8f1f-82bdc9ddda2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:12.710442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876689f5-91d9-4f06-8f1f-82bdc9ddda2a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:12.718753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 129/254] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:12.720003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3db1-7bce-4c28-9006-a7462788e59a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.720294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3db1-7bce-4c28-9006-a7462788e59a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.720575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3db1-7bce-4c28-9006-a7462788e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.737209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-218c3db1-7bce-4c28-9006-a7462788e59a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:12.738531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-218c3db1-7bce-4c28-9006-a7462788e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:12.738787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f612080-6671-42db-9bf1-bb607f76bf61 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.772866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139712c3-d234-4d0a-b1e4-204a2180550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.773945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139712c3-d234-4d0a-b1e4-204a2180550f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.774362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139712c3-d234-4d0a-b1e4-204a2180550f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.774636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139712c3-d234-4d0a-b1e4-204a2180550f None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.775813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139712c3-d234-4d0a-b1e4-204a2180550f None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:12.777255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139712c3-d234-4d0a-b1e4-204a2180550f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:12.778990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 126/255] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:12 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:12.779824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139712c3-d234-4d0a-b1e4-204a2180550f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.806172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 130/256] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:12.807077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3db1-7bce-4c28-9006-a7462788e59a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.879929 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139712c3-d234-4d0a-b1e4-204a2180550f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.904524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3db1-7bce-4c28-9006-a7462788e59a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:12.913022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaceb6f-8e1e-40f1-9997-869faf24ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.913733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaceb6f-8e1e-40f1-9997-869faf24ad24 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.914014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaceb6f-8e1e-40f1-9997-869faf24ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.914289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaceb6f-8e1e-40f1-9997-869faf24ad24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.943353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b91d3c-f78a-483f-9244-2d3dc2c57ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:12.944654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b91d3c-f78a-483f-9244-2d3dc2c57ee7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:12.945135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b91d3c-f78a-483f-9244-2d3dc2c57ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:12.945639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b91d3c-f78a-483f-9244-2d3dc2c57ee7 None admin] PATH_INFO: `/v3/users/fa31d9a3b8ee48199d40a6edbbd37781` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:12.947073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b91d3c-f78a-483f-9244-2d3dc2c57ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=fa31d9a3b8ee48199d40a6edbbd37781)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:12.948795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b91d3c-f78a-483f-9244-2d3dc2c57ee7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:12.950868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 131/257] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:12 2022] GET /identity/v3/users/fa31d9a3b8ee48199d40a6edbbd37781 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:12.951917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b91d3c-f78a-483f-9244-2d3dc2c57ee7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:12.983082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaceb6f-8e1e-40f1-9997-869faf24ad24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:12.984536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaceb6f-8e1e-40f1-9997-869faf24ad24 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:13.051998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b91d3c-f78a-483f-9244-2d3dc2c57ee7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:13.080576 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 127/258] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:13.081786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaceb6f-8e1e-40f1-9997-869faf24ad24 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:13.090960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196c208-41ed-4fd0-934f-8d92a25919ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:13.092265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196c208-41ed-4fd0-934f-8d92a25919ef None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:13.093022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196c208-41ed-4fd0-934f-8d92a25919ef None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:13.093924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196c208-41ed-4fd0-934f-8d92a25919ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:13.095010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196c208-41ed-4fd0-934f-8d92a25919ef None admin] RBAC: Adding query filter params (role.id=7e055f7884c84073918d471ba5d53247, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f, user.id=64b1f889ee7b4d96b8ceeacce4acaf64) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:13.095563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196c208-41ed-4fd0-934f-8d92a25919ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:13.097387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196c208-41ed-4fd0-934f-8d92a25919ef None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:13.104068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 132/259] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:12 2022] GET /identity/v3/role_assignments?user.id=64b1f889ee7b4d96b8ceeacce4acaf64&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=7e055f7884c84073918d471ba5d53247 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:13.105185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196c208-41ed-4fd0-934f-8d92a25919ef None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:13.184139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaceb6f-8e1e-40f1-9997-869faf24ad24 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:13.211273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196c208-41ed-4fd0-934f-8d92a25919ef None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:13.219247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58364-f591-4c4d-a71d-077abda15393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:13.220110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58364-f591-4c4d-a71d-077abda15393 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:13.220393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58364-f591-4c4d-a71d-077abda15393 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:13.220667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf58364-f591-4c4d-a71d-077abda15393 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:13.231340 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf58364-f591-4c4d-a71d-077abda15393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-fcf58364-f591-4c4d-a71d-077abda15393 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:13.239561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:13.240572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:13.241384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 128/260] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:13.242574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58364-f591-4c4d-a71d-077abda15393 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:13.253358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559ddd2-9009-408d-89e5-ca488a17553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:13.254626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559ddd2-9009-408d-89e5-ca488a17553d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:13.255181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559ddd2-9009-408d-89e5-ca488a17553d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:13.255677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559ddd2-9009-408d-89e5-ca488a17553d None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:13.257275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559ddd2-9009-408d-89e5-ca488a17553d None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:13.259045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559ddd2-9009-408d-89e5-ca488a17553d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:13.261105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 133/261] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:13 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:13.262182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559ddd2-9009-408d-89e5-ca488a17553d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:13.350126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf58364-f591-4c4d-a71d-077abda15393 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:13.367876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559ddd2-9009-408d-89e5-ca488a17553d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:13.395115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305c3a9-9d31-47dd-895d-19f6fa96bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:13.396044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305c3a9-9d31-47dd-895d-19f6fa96bbd0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:13.396384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305c3a9-9d31-47dd-895d-19f6fa96bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:13.396661 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305c3a9-9d31-47dd-895d-19f6fa96bbd0 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:13.402182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305c3a9-9d31-47dd-895d-19f6fa96bbd0 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:13.403680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305c3a9-9d31-47dd-895d-19f6fa96bbd0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:13.403987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ce1b-8835-4365-9a46-e5b37166c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:13.404915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ce1b-8835-4365-9a46-e5b37166c1aa None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:13.405436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ce1b-8835-4365-9a46-e5b37166c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:13.405554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 129/262] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:13 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:13.406010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ce1b-8835-4365-9a46-e5b37166c1aa None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:13.406350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305c3a9-9d31-47dd-895d-19f6fa96bbd0 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:13.407183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ce1b-8835-4365-9a46-e5b37166c1aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:13.407685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ce1b-8835-4365-9a46-e5b37166c1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:13.409272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ce1b-8835-4365-9a46-e5b37166c1aa None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:13.418474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 134/263] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:13.419654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ce1b-8835-4365-9a46-e5b37166c1aa None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:13.514164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305c3a9-9d31-47dd-895d-19f6fa96bbd0 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:13.528610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ce1b-8835-4365-9a46-e5b37166c1aa None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:13.549484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77c46-bd5e-4a3e-a3a2-5243efe8767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:13.550404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77c46-bd5e-4a3e-a3a2-5243efe8767a None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:13.550679 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77c46-bd5e-4a3e-a3a2-5243efe8767a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:13.550949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77c46-bd5e-4a3e-a3a2-5243efe8767a None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/users/fa31d9a3b8ee48199d40a6edbbd37781/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:13.553149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f77c46-bd5e-4a3e-a3a2-5243efe8767a None admin] RBAC: Authorizing `identity:create_grant(project_id=a6737563b3a84f8385cbad6b6c06f54f, user_id=fa31d9a3b8ee48199d40a6edbbd37781, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:13.555425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f77c46-bd5e-4a3e-a3a2-5243efe8767a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:13.568060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b36ae-2652-4758-b406-e98b5d81049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:13.569092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b36ae-2652-4758-b406-e98b5d81049d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:13.569607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b36ae-2652-4758-b406-e98b5d81049d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:13.570077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b36ae-2652-4758-b406-e98b5d81049d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:13.571112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b36ae-2652-4758-b406-e98b5d81049d None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f, user.id=121ed507f7db4f82817c7985a9a50a54) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:13.571629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b36ae-2652-4758-b406-e98b5d81049d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:13.571807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 130/264] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:43:13 2022] PUT /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/users/fa31d9a3b8ee48199d40a6edbbd37781/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:13.572859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77c46-bd5e-4a3e-a3a2-5243efe8767a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:13.573750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b36ae-2652-4758-b406-e98b5d81049d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:13.586788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 135/265] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:13 2022] GET /identity/v3/role_assignments?user.id=121ed507f7db4f82817c7985a9a50a54&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:13.716683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77c46-bd5e-4a3e-a3a2-5243efe8767a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:13.759502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5cb5-5f21-4c78-8179-73020eac889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:13.760846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5cb5-5f21-4c78-8179-73020eac889e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:13.761348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5cb5-5f21-4c78-8179-73020eac889e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:13.761844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5cb5-5f21-4c78-8179-73020eac889e None admin] PATH_INFO: `/v3/users/121ed507f7db4f82817c7985a9a50a54` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:13.766267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5cb5-5f21-4c78-8179-73020eac889e None admin] RBAC: Authorizing `identity:get_user(user_id=121ed507f7db4f82817c7985a9a50a54)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:13.768153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5cb5-5f21-4c78-8179-73020eac889e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:13.770184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 131/266] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:13 2022] GET /identity/v3/users/121ed507f7db4f82817c7985a9a50a54 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:13.776214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b36ae-2652-4758-b406-e98b5d81049d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:13.899683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b36ae-2652-4758-b406-e98b5d81049d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:13.943790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911c9f2-0c61-4e2c-a883-ad7a62331b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:13.944899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911c9f2-0c61-4e2c-a883-ad7a62331b09 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:13.945468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911c9f2-0c61-4e2c-a883-ad7a62331b09 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:13.946000 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911c9f2-0c61-4e2c-a883-ad7a62331b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:14.027051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911c9f2-0c61-4e2c-a883-ad7a62331b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:14.028879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911c9f2-0c61-4e2c-a883-ad7a62331b09 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:14.139481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 136/267] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:14.144851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5cb5-5f21-4c78-8179-73020eac889e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:14.259861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5cb5-5f21-4c78-8179-73020eac889e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:14.296149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eecb5d-1179-4521-940f-19a4ee3d3f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:14.297413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eecb5d-1179-4521-940f-19a4ee3d3f26 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:14.297893 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eecb5d-1179-4521-940f-19a4ee3d3f26 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:14.298373 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eecb5d-1179-4521-940f-19a4ee3d3f26 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:14.306084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eecb5d-1179-4521-940f-19a4ee3d3f26 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:14.307813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eecb5d-1179-4521-940f-19a4ee3d3f26 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:14.310305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 132/268] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:14 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:14.316075 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911c9f2-0c61-4e2c-a883-ad7a62331b09 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:14.446424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911c9f2-0c61-4e2c-a883-ad7a62331b09 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:14.494568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fe464-716a-40eb-9618-430454af2097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:14.495241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fe464-716a-40eb-9618-430454af2097 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:14.495523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fe464-716a-40eb-9618-430454af2097 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:14.495798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fe464-716a-40eb-9618-430454af2097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:14.496648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fe464-716a-40eb-9618-430454af2097 None admin] RBAC: Adding query filter params (role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f, user.id=121ed507f7db4f82817c7985a9a50a54) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:14.496961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fe464-716a-40eb-9618-430454af2097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:14.498448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fe464-716a-40eb-9618-430454af2097 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:14.505101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 137/269] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:14 2022] GET /identity/v3/role_assignments?user.id=121ed507f7db4f82817c7985a9a50a54&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=812e67b7a9204b8f925c8e613b2209de => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:14.617242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db751cd3-198a-439a-9661-25f971187e03 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:14.617874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db751cd3-198a-439a-9661-25f971187e03 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:14.618358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db751cd3-198a-439a-9661-25f971187e03 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:14.620013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 133/270] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:14.626295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6ede3-f7a2-459f-a0cd-49319b0d0204 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:14.626601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6ede3-f7a2-459f-a0cd-49319b0d0204 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:14.626865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6ede3-f7a2-459f-a0cd-49319b0d0204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:14.650476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6eb6ede3-f7a2-459f-a0cd-49319b0d0204 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:14.651769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6eb6ede3-f7a2-459f-a0cd-49319b0d0204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:14.731942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 138/271] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:14.779693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db751cd3-198a-439a-9661-25f971187e03 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:14.897833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db751cd3-198a-439a-9661-25f971187e03 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:14.932982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942ed01-1a6b-4cbe-9b01-f518bf47ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:14.933838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942ed01-1a6b-4cbe-9b01-f518bf47ed7b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:14.934118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942ed01-1a6b-4cbe-9b01-f518bf47ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:14.934392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942ed01-1a6b-4cbe-9b01-f518bf47ed7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:14.947179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942ed01-1a6b-4cbe-9b01-f518bf47ed7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-1942ed01-1a6b-4cbe-9b01-f518bf47ed7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:14.955114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:14.955999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:14.956787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 134/272] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:14.962317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6ede3-f7a2-459f-a0cd-49319b0d0204 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:15.027686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b03ac-6a75-49e3-888b-47d85b103e99 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:15.028007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b03ac-6a75-49e3-888b-47d85b103e99 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:15.028296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b03ac-6a75-49e3-888b-47d85b103e99 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:15.029949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 135/273] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:15.035630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fa33b-b7ac-41ed-a5a4-6543d187bd4a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:15.036239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fa33b-b7ac-41ed-a5a4-6543d187bd4a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:15.036517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fa33b-b7ac-41ed-a5a4-6543d187bd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:15.060563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-095fa33b-b7ac-41ed-a5a4-6543d187bd4a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:15.061946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-095fa33b-b7ac-41ed-a5a4-6543d187bd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:15.089689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6ede3-f7a2-459f-a0cd-49319b0d0204 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:15.124181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1b9c6-27b0-4c0e-941c-12ab104f217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:15.125475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b9c6-27b0-4c0e-941c-12ab104f217d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:15.125951 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b9c6-27b0-4c0e-941c-12ab104f217d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:15.126393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b9c6-27b0-4c0e-941c-12ab104f217d None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:15.127318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1b9c6-27b0-4c0e-941c-12ab104f217d None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:15.127791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1b9c6-27b0-4c0e-941c-12ab104f217d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:15.129346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1b9c6-27b0-4c0e-941c-12ab104f217d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:15.134935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 136/274] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:15.141392 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 139/275] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:15.144052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fa33b-b7ac-41ed-a5a4-6543d187bd4a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:15.160661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1b9c6-27b0-4c0e-941c-12ab104f217d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:15.248441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fa33b-b7ac-41ed-a5a4-6543d187bd4a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:15.285561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1b9c6-27b0-4c0e-941c-12ab104f217d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:15.287604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37be65-4191-40d0-803c-f432a58e9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:15.289084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37be65-4191-40d0-803c-f432a58e9a26 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:15.289572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37be65-4191-40d0-803c-f432a58e9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:15.290020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37be65-4191-40d0-803c-f432a58e9a26 None admin] PATH_INFO: `/v3/users/3aefc1aac978492a955671f2cb2f1f47` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:15.304504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37be65-4191-40d0-803c-f432a58e9a26 None admin] RBAC: Authorizing `identity:get_user(user_id=3aefc1aac978492a955671f2cb2f1f47)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:15.306361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37be65-4191-40d0-803c-f432a58e9a26 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:15.308312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 137/276] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:15 2022] GET /identity/v3/users/3aefc1aac978492a955671f2cb2f1f47 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:15.314345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37be65-4191-40d0-803c-f432a58e9a26 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:15.321046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b2ef2-00ec-4093-88eb-6646fefaf250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:15.321884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b2ef2-00ec-4093-88eb-6646fefaf250 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:15.322170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b2ef2-00ec-4093-88eb-6646fefaf250 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:15.322446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b2ef2-00ec-4093-88eb-6646fefaf250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:15.323620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b2ef2-00ec-4093-88eb-6646fefaf250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:15.325065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b2ef2-00ec-4093-88eb-6646fefaf250 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:15.326886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 140/277] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:15.332295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b2ef2-00ec-4093-88eb-6646fefaf250 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:15.430144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37be65-4191-40d0-803c-f432a58e9a26 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:15.436135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b2ef2-00ec-4093-88eb-6646fefaf250 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:15.466427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7620c-99a8-4edc-a988-9b58e1a164b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:15.467492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7620c-99a8-4edc-a988-9b58e1a164b8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:15.467492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7620c-99a8-4edc-a988-9b58e1a164b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:15.467624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7620c-99a8-4edc-a988-9b58e1a164b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:15.468546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7620c-99a8-4edc-a988-9b58e1a164b8 None admin] RBAC: Adding query filter params (role.id=fda329dea4e7408c9791a6554d482329, user.id=3aefc1aac978492a955671f2cb2f1f47, scope.system=all) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:15.468664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7620c-99a8-4edc-a988-9b58e1a164b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:15.470136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7620c-99a8-4edc-a988-9b58e1a164b8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:15.477326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74b193-8e0d-43b5-af26-9b6090ac8514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:15.478262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74b193-8e0d-43b5-af26-9b6090ac8514 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:15.478751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74b193-8e0d-43b5-af26-9b6090ac8514 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:15.479252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74b193-8e0d-43b5-af26-9b6090ac8514 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:15.480164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74b193-8e0d-43b5-af26-9b6090ac8514 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:15.481428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 138/278] 10.222.0.35 () {56 vars in 1308 bytes} [Wed May 4 18:43:15 2022] GET /identity/v3/role_assignments?user.id=3aefc1aac978492a955671f2cb2f1f47&scope.system=all&role.id=fda329dea4e7408c9791a6554d482329 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:15.482124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74b193-8e0d-43b5-af26-9b6090ac8514 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:15.508572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 141/279] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:43:15 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:43:16.151130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47365203-805d-40c5-9d92-010ed4b39456 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:16.151848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47365203-805d-40c5-9d92-010ed4b39456 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:16.152351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47365203-805d-40c5-9d92-010ed4b39456 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:16.154214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 139/280] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:16.159249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9c37-1cfc-4197-88a5-affd31cce4b7 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:16.159767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9c37-1cfc-4197-88a5-affd31cce4b7 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:16.160304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9c37-1cfc-4197-88a5-affd31cce4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:16.181658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5c0e9c37-1cfc-4197-88a5-affd31cce4b7 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:16.183579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5c0e9c37-1cfc-4197-88a5-affd31cce4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:16.265327 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 142/281] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:16.287565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47365203-805d-40c5-9d92-010ed4b39456 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:16.411516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47365203-805d-40c5-9d92-010ed4b39456 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:16.452279 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612e5d-a4ed-41a8-a3e8-36f536f2aad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:16.453085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612e5d-a4ed-41a8-a3e8-36f536f2aad0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:16.453389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612e5d-a4ed-41a8-a3e8-36f536f2aad0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:16.453658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612e5d-a4ed-41a8-a3e8-36f536f2aad0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:16.467787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612e5d-a4ed-41a8-a3e8-36f536f2aad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:16.476570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b75d0-310c-4f8e-bd2e-b41ae0247ade None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:16.477021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b75d0-310c-4f8e-bd2e-b41ae0247ade None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:16.477119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b75d0-310c-4f8e-bd2e-b41ae0247ade None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-22612e5d-a4ed-41a8-a3e8-36f536f2aad0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:16.479574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:16.480463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:16.481270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:16.481914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 143/282] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:16.481983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 140/283] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:16.485253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b75d0-310c-4f8e-bd2e-b41ae0247ade None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:16.487853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb45b3e-0509-49b2-b696-9807c6d2c8a3 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:16.488141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb45b3e-0509-49b2-b696-9807c6d2c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:16.488420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb45b3e-0509-49b2-b696-9807c6d2c8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:16.517184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-1fb45b3e-0509-49b2-b696-9807c6d2c8a3 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:16.518390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1fb45b3e-0509-49b2-b696-9807c6d2c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:16.587524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b75d0-310c-4f8e-bd2e-b41ae0247ade None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:16.619593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 141/284] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:16.622701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b276ddc-d06c-42e5-88ee-ae2148e243aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:16.623596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b276ddc-d06c-42e5-88ee-ae2148e243aa None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:16.624111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b276ddc-d06c-42e5-88ee-ae2148e243aa None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:16.624595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b276ddc-d06c-42e5-88ee-ae2148e243aa None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:16.625940 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b276ddc-d06c-42e5-88ee-ae2148e243aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:16.626477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b276ddc-d06c-42e5-88ee-ae2148e243aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:16.628060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b276ddc-d06c-42e5-88ee-ae2148e243aa None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:16.638319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 144/285] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:16.644454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb45b3e-0509-49b2-b696-9807c6d2c8a3 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:16.654103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b276ddc-d06c-42e5-88ee-ae2148e243aa None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:16.783651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b276ddc-d06c-42e5-88ee-ae2148e243aa None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:16.807987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb45b3e-0509-49b2-b696-9807c6d2c8a3 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:16.816791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516cf87-119e-4203-b41c-0df5a478fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:16.817987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516cf87-119e-4203-b41c-0df5a478fa6e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:16.818467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516cf87-119e-4203-b41c-0df5a478fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:16.818930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516cf87-119e-4203-b41c-0df5a478fa6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:16.829476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516cf87-119e-4203-b41c-0df5a478fa6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-c516cf87-119e-4203-b41c-0df5a478fa6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:16.839141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:16.840093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:16.840897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:16.843592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 145/286] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:16.854308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516cf87-119e-4203-b41c-0df5a478fa6e None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:16.870241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc6c05-1173-4985-af61-5def54135cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:16.871135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc6c05-1173-4985-af61-5def54135cdb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:16.871414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc6c05-1173-4985-af61-5def54135cdb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:16.871687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc6c05-1173-4985-af61-5def54135cdb None admin] PATH_INFO: `/v3/users/64b1f889ee7b4d96b8ceeacce4acaf64` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:16.878035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc6c05-1173-4985-af61-5def54135cdb None admin] RBAC: Authorizing `identity:get_user(user_id=64b1f889ee7b4d96b8ceeacce4acaf64)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:16.879520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc6c05-1173-4985-af61-5def54135cdb None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:16.881363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 142/287] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:16 2022] GET /identity/v3/users/64b1f889ee7b4d96b8ceeacce4acaf64 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:16.888996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc6c05-1173-4985-af61-5def54135cdb None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:16.961755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516cf87-119e-4203-b41c-0df5a478fa6e None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:17.017617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34543-ee94-4666-88f8-07928b87449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:17.018634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34543-ee94-4666-88f8-07928b87449f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:17.019111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34543-ee94-4666-88f8-07928b87449f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:17.019490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc6c05-1173-4985-af61-5def54135cdb None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:17.019803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34543-ee94-4666-88f8-07928b87449f None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:17.020801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a34543-ee94-4666-88f8-07928b87449f None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:17.021316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a34543-ee94-4666-88f8-07928b87449f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:17.022901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a34543-ee94-4666-88f8-07928b87449f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:17.039750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 146/288] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:17.046819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34543-ee94-4666-88f8-07928b87449f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:17.066892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049fe9e-97b7-46fa-adc6-a5519d7d4648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:17.067829 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049fe9e-97b7-46fa-adc6-a5519d7d4648 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:17.068110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049fe9e-97b7-46fa-adc6-a5519d7d4648 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:17.068385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049fe9e-97b7-46fa-adc6-a5519d7d4648 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:17.070539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049fe9e-97b7-46fa-adc6-a5519d7d4648 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:17.071847 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049fe9e-97b7-46fa-adc6-a5519d7d4648 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:17.077701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 143/289] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:16 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:17.085660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049fe9e-97b7-46fa-adc6-a5519d7d4648 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:17.152133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34543-ee94-4666-88f8-07928b87449f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:17.185591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049fe9e-97b7-46fa-adc6-a5519d7d4648 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:17.186465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53179b78-1340-4840-9eda-79a263e87fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:17.187776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53179b78-1340-4840-9eda-79a263e87fae None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:17.188298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53179b78-1340-4840-9eda-79a263e87fae None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:17.188803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53179b78-1340-4840-9eda-79a263e87fae None admin] PATH_INFO: `/v3/users/fa31d9a3b8ee48199d40a6edbbd37781` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:17.190263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53179b78-1340-4840-9eda-79a263e87fae None admin] RBAC: Authorizing `identity:get_user(user_id=fa31d9a3b8ee48199d40a6edbbd37781)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:17.191902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53179b78-1340-4840-9eda-79a263e87fae None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:17.194129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 147/290] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:17 2022] GET /identity/v3/users/fa31d9a3b8ee48199d40a6edbbd37781 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:17.206155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53179b78-1340-4840-9eda-79a263e87fae None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:17.260313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ad270-695a-4870-8e8d-2a4beb378032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:17.261229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ad270-695a-4870-8e8d-2a4beb378032 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:17.263660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ad270-695a-4870-8e8d-2a4beb378032 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:17.263982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ad270-695a-4870-8e8d-2a4beb378032 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/users/64b1f889ee7b4d96b8ceeacce4acaf64/roles/7e055f7884c84073918d471ba5d53247` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:17.274637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ad270-695a-4870-8e8d-2a4beb378032 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6737563b3a84f8385cbad6b6c06f54f, user_id=64b1f889ee7b4d96b8ceeacce4acaf64, role_id=7e055f7884c84073918d471ba5d53247)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:17.275882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ad270-695a-4870-8e8d-2a4beb378032 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:17.300080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 144/291] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:43:17 2022] PUT /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/users/64b1f889ee7b4d96b8ceeacce4acaf64/roles/7e055f7884c84073918d471ba5d53247 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:17.341693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53179b78-1340-4840-9eda-79a263e87fae None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:17.385330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead970cd-ca78-4b55-8d55-388f6c115cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:17.386436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead970cd-ca78-4b55-8d55-388f6c115cab None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:17.386946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead970cd-ca78-4b55-8d55-388f6c115cab None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:17.387409 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead970cd-ca78-4b55-8d55-388f6c115cab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:17.474429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead970cd-ca78-4b55-8d55-388f6c115cab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:17.475893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead970cd-ca78-4b55-8d55-388f6c115cab None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:17.580548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 148/292] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:17.585901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ad270-695a-4870-8e8d-2a4beb378032 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:17.736593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ad270-695a-4870-8e8d-2a4beb378032 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:17.772248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672dea1-266e-4299-ab74-9b137b3eef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:17.773119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672dea1-266e-4299-ab74-9b137b3eef24 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:17.773469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672dea1-266e-4299-ab74-9b137b3eef24 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:17.773748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672dea1-266e-4299-ab74-9b137b3eef24 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:17.774945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672dea1-266e-4299-ab74-9b137b3eef24 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:17.776396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672dea1-266e-4299-ab74-9b137b3eef24 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:17.778131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 145/293] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:17 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:17.784035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead970cd-ca78-4b55-8d55-388f6c115cab None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:17.867061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a787-d53e-4d91-a704-8d14234bf756 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:17.867665 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a787-d53e-4d91-a704-8d14234bf756 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:17.868135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a787-d53e-4d91-a704-8d14234bf756 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:17.869764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 146/294] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:17.875597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db0286-9570-47a4-a85e-c2eea8c20626 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:17.876115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db0286-9570-47a4-a85e-c2eea8c20626 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:17.876598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db0286-9570-47a4-a85e-c2eea8c20626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:17.882366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead970cd-ca78-4b55-8d55-388f6c115cab None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:17.914414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-92db0286-9570-47a4-a85e-c2eea8c20626 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:17.915577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-92db0286-9570-47a4-a85e-c2eea8c20626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:17.921009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d5123-538b-4d04-8337-f3bec278eaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:17.921776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d5123-538b-4d04-8337-f3bec278eaf7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:17.922067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d5123-538b-4d04-8337-f3bec278eaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:17.922333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d5123-538b-4d04-8337-f3bec278eaf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:17.923178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d5123-538b-4d04-8337-f3bec278eaf7 None admin] RBAC: Adding query filter params (role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f, user.id=fa31d9a3b8ee48199d40a6edbbd37781) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:17.923486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d5123-538b-4d04-8337-f3bec278eaf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:17.924926 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d5123-538b-4d04-8337-f3bec278eaf7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:17.937913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 149/295] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:17 2022] GET /identity/v3/role_assignments?user.id=fa31d9a3b8ee48199d40a6edbbd37781&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=fda329dea4e7408c9791a6554d482329 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:18.018809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 147/296] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:18.057655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d5123-538b-4d04-8337-f3bec278eaf7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:18.163710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d5123-538b-4d04-8337-f3bec278eaf7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:18.198051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275993b9-8921-4298-8e5b-c9ce4fc0dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:18.198860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275993b9-8921-4298-8e5b-c9ce4fc0dd5f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:18.199138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275993b9-8921-4298-8e5b-c9ce4fc0dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:18.199412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275993b9-8921-4298-8e5b-c9ce4fc0dd5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:18.209860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275993b9-8921-4298-8e5b-c9ce4fc0dd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-275993b9-8921-4298-8e5b-c9ce4fc0dd5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:18.217513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:18.218380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:18.219315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 150/297] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:18.226748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db0286-9570-47a4-a85e-c2eea8c20626 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:18.346037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db0286-9570-47a4-a85e-c2eea8c20626 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:18.393835 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525fa00-f27e-45d9-b5a6-c1f4ff895411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:18.394525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525fa00-f27e-45d9-b5a6-c1f4ff895411 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:18.394802 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525fa00-f27e-45d9-b5a6-c1f4ff895411 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:18.395108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525fa00-f27e-45d9-b5a6-c1f4ff895411 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:18.395877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525fa00-f27e-45d9-b5a6-c1f4ff895411 None admin] RBAC: Adding query filter params (name=member) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:18.396185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525fa00-f27e-45d9-b5a6-c1f4ff895411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:18.397578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525fa00-f27e-45d9-b5a6-c1f4ff895411 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:18.411539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 148/298] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:18.416374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275993b9-8921-4298-8e5b-c9ce4fc0dd5f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:18.541660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275993b9-8921-4298-8e5b-c9ce4fc0dd5f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:18.555369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cd403-c147-4dd5-ae90-24db3ea4c42a None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:18.556002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cd403-c147-4dd5-ae90-24db3ea4c42a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:18.556457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cd403-c147-4dd5-ae90-24db3ea4c42a None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:18.557852 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 149/299] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:18.563161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbba1d-1dae-452d-b93e-b2d98e243294 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:18.563446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbba1d-1dae-452d-b93e-b2d98e243294 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:18.563908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbba1d-1dae-452d-b93e-b2d98e243294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:18.581326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-26dbba1d-1dae-452d-b93e-b2d98e243294 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:18.582955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-26dbba1d-1dae-452d-b93e-b2d98e243294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:18.585227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df65e-d88e-4fec-9991-3b4dac1dfcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:18.586101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df65e-d88e-4fec-9991-3b4dac1dfcbf None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:18.586371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df65e-d88e-4fec-9991-3b4dac1dfcbf None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:18.586640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df65e-d88e-4fec-9991-3b4dac1dfcbf None admin] PATH_INFO: `/v3/users/3aefc1aac978492a955671f2cb2f1f47` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:18.587874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450df65e-d88e-4fec-9991-3b4dac1dfcbf None admin] RBAC: Authorizing `identity:get_user(user_id=3aefc1aac978492a955671f2cb2f1f47)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:18.589237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450df65e-d88e-4fec-9991-3b4dac1dfcbf None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:18.595699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 151/300] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:18 2022] GET /identity/v3/users/3aefc1aac978492a955671f2cb2f1f47 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:18.597094 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df65e-d88e-4fec-9991-3b4dac1dfcbf None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:18.685615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 150/301] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:18.689457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc8474-be13-46d5-ad57-7b266a947a1f None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:18.689457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc8474-be13-46d5-ad57-7b266a947a1f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:18.689457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc8474-be13-46d5-ad57-7b266a947a1f None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:18.689457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 151/302] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:18.694609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb44ef7-32d6-425d-98ef-b1c40d12a289 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:18.694890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb44ef7-32d6-425d-98ef-b1c40d12a289 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:18.695162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb44ef7-32d6-425d-98ef-b1c40d12a289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:18.704408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df65e-d88e-4fec-9991-3b4dac1dfcbf None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:18.714644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-2fb44ef7-32d6-425d-98ef-b1c40d12a289 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:18.716048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2fb44ef7-32d6-425d-98ef-b1c40d12a289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:18.750148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009996f7-aebe-4de8-ae00-893b13503d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:18.751170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009996f7-aebe-4de8-ae00-893b13503d62 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:18.751451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009996f7-aebe-4de8-ae00-893b13503d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:18.752500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009996f7-aebe-4de8-ae00-893b13503d62 None admin] PATH_INFO: `/v3/system/users/3aefc1aac978492a955671f2cb2f1f47/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:18.754020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009996f7-aebe-4de8-ae00-893b13503d62 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3aefc1aac978492a955671f2cb2f1f47, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:18.756891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009996f7-aebe-4de8-ae00-893b13503d62 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:18.768395 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 152/303] 10.222.0.35 () {58 vars in 1334 bytes} [Wed May 4 18:43:18 2022] PUT /identity/v3/system/users/3aefc1aac978492a955671f2cb2f1f47/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:43:18.769377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009996f7-aebe-4de8-ae00-893b13503d62 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:18.798800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 152/304] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:18.821443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb44ef7-32d6-425d-98ef-b1c40d12a289 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:18.891346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009996f7-aebe-4de8-ae00-893b13503d62 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:18.927337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62ccaa-e07d-49af-9966-b244b808092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:18.928657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62ccaa-e07d-49af-9966-b244b808092e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:18.929143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62ccaa-e07d-49af-9966-b244b808092e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:18.929629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62ccaa-e07d-49af-9966-b244b808092e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:18.947054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62ccaa-e07d-49af-9966-b244b808092e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:18.954378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb44ef7-32d6-425d-98ef-b1c40d12a289 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-7c62ccaa-e07d-49af-9966-b244b808092e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:18.955928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:18.956804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:18.957677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:18.965237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 153/305] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:18.967529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62ccaa-e07d-49af-9966-b244b808092e None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:19.001668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9219d-99f5-4873-9648-003233b5ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:19.002475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9219d-99f5-4873-9648-003233b5ad8a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:19.002751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9219d-99f5-4873-9648-003233b5ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:19.003025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9219d-99f5-4873-9648-003233b5ad8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:19.004887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9219d-99f5-4873-9648-003233b5ad8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:19.006374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9219d-99f5-4873-9648-003233b5ad8a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:19.008220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 153/306] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:19.014915 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9219d-99f5-4873-9648-003233b5ad8a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:19.088396 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62ccaa-e07d-49af-9966-b244b808092e None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:19.113941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9219d-99f5-4873-9648-003233b5ad8a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:19.125989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c09317-92b5-4cef-9b58-f57bd922092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:19.126997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c09317-92b5-4cef-9b58-f57bd922092b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:19.127419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c09317-92b5-4cef-9b58-f57bd922092b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:19.127986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c09317-92b5-4cef-9b58-f57bd922092b None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:19.129274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c09317-92b5-4cef-9b58-f57bd922092b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:19.130105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c09317-92b5-4cef-9b58-f57bd922092b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:19.131846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c09317-92b5-4cef-9b58-f57bd922092b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:19.149642 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 154/307] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:19.153276 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c09317-92b5-4cef-9b58-f57bd922092b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:19.156280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a07b7-80fa-47a9-9196-3dbafaa14bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:19.157967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a07b7-80fa-47a9-9196-3dbafaa14bcb None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:19.158413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a07b7-80fa-47a9-9196-3dbafaa14bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:19.158833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a07b7-80fa-47a9-9196-3dbafaa14bcb None admin] PATH_INFO: `/v3/groups` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:19.159669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a07b7-80fa-47a9-9196-3dbafaa14bcb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:19.161396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a07b7-80fa-47a9-9196-3dbafaa14bcb None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:19.182965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 154/308] 10.222.0.35 () {60 vars in 1134 bytes} [Wed May 4 18:43:19 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:43:19.278708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c09317-92b5-4cef-9b58-f57bd922092b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:19.317852 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4551ba-bcc2-4993-85e5-17ae97910d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:19.319341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4551ba-bcc2-4993-85e5-17ae97910d8d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:19.319819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4551ba-bcc2-4993-85e5-17ae97910d8d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:19.320232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4551ba-bcc2-4993-85e5-17ae97910d8d None admin] PATH_INFO: `/v3/users/e9ef7709e81840efab882d49c7091af5` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:19.339079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4551ba-bcc2-4993-85e5-17ae97910d8d None admin] RBAC: Authorizing `identity:get_user(user_id=e9ef7709e81840efab882d49c7091af5)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:19.340837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4551ba-bcc2-4993-85e5-17ae97910d8d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:19.349474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 155/309] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:19 2022] GET /identity/v3/users/e9ef7709e81840efab882d49c7091af5 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:19.351505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a07b7-80fa-47a9-9196-3dbafaa14bcb None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:19.466586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a07b7-80fa-47a9-9196-3dbafaa14bcb None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:19.493531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111851b6-35e1-4fdd-9a23-a9d20af536e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:19.493531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111851b6-35e1-4fdd-9a23-a9d20af536e2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:19.493531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111851b6-35e1-4fdd-9a23-a9d20af536e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:19.493887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111851b6-35e1-4fdd-9a23-a9d20af536e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:19.494598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111851b6-35e1-4fdd-9a23-a9d20af536e2 None admin] RBAC: Adding query filter params (role.id=7e055f7884c84073918d471ba5d53247, user.id=e9ef7709e81840efab882d49c7091af5, scope.system=all) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:19.494906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111851b6-35e1-4fdd-9a23-a9d20af536e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:19.496335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111851b6-35e1-4fdd-9a23-a9d20af536e2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:19.502269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 155/310] 10.222.0.35 () {56 vars in 1308 bytes} [Wed May 4 18:43:19 2022] GET /identity/v3/role_assignments?user.id=e9ef7709e81840efab882d49c7091af5&scope.system=all&role.id=7e055f7884c84073918d471ba5d53247 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:20.022613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e54f07-e864-425d-8f34-9e11415a3b51 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:20.023165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e54f07-e864-425d-8f34-9e11415a3b51 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:20.023165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e54f07-e864-425d-8f34-9e11415a3b51 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:20.024800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 156/311] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:20.030269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218e1dc-21d9-4859-ac3b-fe1d6c474882 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:20.030652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218e1dc-21d9-4859-ac3b-fe1d6c474882 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:20.030829 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218e1dc-21d9-4859-ac3b-fe1d6c474882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:20.047698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0218e1dc-21d9-4859-ac3b-fe1d6c474882 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:20.048864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0218e1dc-21d9-4859-ac3b-fe1d6c474882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:20.112526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 156/312] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:20.135898 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e54f07-e864-425d-8f34-9e11415a3b51 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:20.235638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e54f07-e864-425d-8f34-9e11415a3b51 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:20.269168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b8694-8dd9-426c-81b3-ec8f379b1320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:20.270002 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b8694-8dd9-426c-81b3-ec8f379b1320 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:20.270381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b8694-8dd9-426c-81b3-ec8f379b1320 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:20.270656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b8694-8dd9-426c-81b3-ec8f379b1320 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:20.281058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b8694-8dd9-426c-81b3-ec8f379b1320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-264b8694-8dd9-426c-81b3-ec8f379b1320 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:20.288789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:20.289708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:20.290501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:20.294879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 157/313] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:20.296259 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218e1dc-21d9-4859-ac3b-fe1d6c474882 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:20.402489 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218e1dc-21d9-4859-ac3b-fe1d6c474882 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:20.436788 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b599467-32aa-4bdd-9ad5-b7f906b3fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:20.437480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b599467-32aa-4bdd-9ad5-b7f906b3fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:20.437756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b599467-32aa-4bdd-9ad5-b7f906b3fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:20.438025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b599467-32aa-4bdd-9ad5-b7f906b3fcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:20.438779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b599467-32aa-4bdd-9ad5-b7f906b3fcf4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:20.439079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b599467-32aa-4bdd-9ad5-b7f906b3fcf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:20.440450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b599467-32aa-4bdd-9ad5-b7f906b3fcf4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:20.448963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 157/314] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:20.455639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b8694-8dd9-426c-81b3-ec8f379b1320 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:20.556961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b8694-8dd9-426c-81b3-ec8f379b1320 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:20.590984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df0e8e-a293-4408-b2d4-b0ae965a4027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:20.591863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df0e8e-a293-4408-b2d4-b0ae965a4027 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:20.592142 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df0e8e-a293-4408-b2d4-b0ae965a4027 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:20.592407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df0e8e-a293-4408-b2d4-b0ae965a4027 None admin] PATH_INFO: `/v3/users/64b1f889ee7b4d96b8ceeacce4acaf64` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:20.593641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df0e8e-a293-4408-b2d4-b0ae965a4027 None admin] RBAC: Authorizing `identity:get_user(user_id=64b1f889ee7b4d96b8ceeacce4acaf64)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:20.595109 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df0e8e-a293-4408-b2d4-b0ae965a4027 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:20.597029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 158/315] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:20 2022] GET /identity/v3/users/64b1f889ee7b4d96b8ceeacce4acaf64 => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:20.602364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b599467-32aa-4bdd-9ad5-b7f906b3fcf4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:20.702528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b599467-32aa-4bdd-9ad5-b7f906b3fcf4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:20.735123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeca90-2f40-46c0-8803-334c72374964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:20.735773 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeca90-2f40-46c0-8803-334c72374964 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:20.736049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeca90-2f40-46c0-8803-334c72374964 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:20.736323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeca90-2f40-46c0-8803-334c72374964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:20.805395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeca90-2f40-46c0-8803-334c72374964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:20.806916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeca90-2f40-46c0-8803-334c72374964 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:20.906879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 158/316] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:20.912188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df0e8e-a293-4408-b2d4-b0ae965a4027 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:21.011702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df0e8e-a293-4408-b2d4-b0ae965a4027 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:21.044578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503633a-b538-4741-bc0e-861acc8eacee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:21.045476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503633a-b538-4741-bc0e-861acc8eacee None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.045765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503633a-b538-4741-bc0e-861acc8eacee None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.046040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503633a-b538-4741-bc0e-861acc8eacee None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.047235 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503633a-b538-4741-bc0e-861acc8eacee None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:21.048687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503633a-b538-4741-bc0e-861acc8eacee None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:21.050724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 159/317] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:20 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:21.058410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeca90-2f40-46c0-8803-334c72374964 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:21.097381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f39c6b-52ce-4d3c-9839-677a73905c80 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.097693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f39c6b-52ce-4d3c-9839-677a73905c80 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.097948 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f39c6b-52ce-4d3c-9839-677a73905c80 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.099598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 160/318] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:21.106153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e37c-967d-4a8c-8e92-094df8152b7a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.106444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e37c-967d-4a8c-8e92-094df8152b7a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.106727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e37c-967d-4a8c-8e92-094df8152b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.128207 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-57a9e37c-967d-4a8c-8e92-094df8152b7a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:21.129760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-57a9e37c-967d-4a8c-8e92-094df8152b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:21.159751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeca90-2f40-46c0-8803-334c72374964 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:21.193928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf99d9-030b-41ed-976c-fe927e357f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:21.194956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf99d9-030b-41ed-976c-fe927e357f20 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.195445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf99d9-030b-41ed-976c-fe927e357f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.195903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf99d9-030b-41ed-976c-fe927e357f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.196931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf99d9-030b-41ed-976c-fe927e357f20 None admin] RBAC: Adding query filter params (role.id=7e055f7884c84073918d471ba5d53247, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f, user.id=64b1f889ee7b4d96b8ceeacce4acaf64) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:21.197457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf99d9-030b-41ed-976c-fe927e357f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:21.199168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf99d9-030b-41ed-976c-fe927e357f20 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:21.205640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 159/319] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:21 2022] GET /identity/v3/role_assignments?user.id=64b1f889ee7b4d96b8ceeacce4acaf64&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=7e055f7884c84073918d471ba5d53247 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:21.217387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 161/320] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:21.233610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf99d9-030b-41ed-976c-fe927e357f20 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:21.340629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf99d9-030b-41ed-976c-fe927e357f20 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:21.379921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98798c84-2a3a-4f07-b561-828e367a28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:21.380748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98798c84-2a3a-4f07-b561-828e367a28c3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.381033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98798c84-2a3a-4f07-b561-828e367a28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.381334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98798c84-2a3a-4f07-b561-828e367a28c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.392914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98798c84-2a3a-4f07-b561-828e367a28c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-98798c84-2a3a-4f07-b561-828e367a28c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:21.400792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:21.401737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:21.402523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 160/321] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:21.408123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9e37c-967d-4a8c-8e92-094df8152b7a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:21.518070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9e37c-967d-4a8c-8e92-094df8152b7a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:21.533804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2c982-10e0-4588-9e64-291b91af5975 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.534113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2c982-10e0-4588-9e64-291b91af5975 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.534387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2c982-10e0-4588-9e64-291b91af5975 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.536100 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 161/322] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:21.540749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a37e24-538d-4672-aa56-6ff92af8e59e None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.541039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a37e24-538d-4672-aa56-6ff92af8e59e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.541331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a37e24-538d-4672-aa56-6ff92af8e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.552200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e1f84-58ce-4843-af06-d49286f93fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:21.552871 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e1f84-58ce-4843-af06-d49286f93fed None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.553149 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e1f84-58ce-4843-af06-d49286f93fed None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.553459 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e1f84-58ce-4843-af06-d49286f93fed None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.554212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e1f84-58ce-4843-af06-d49286f93fed None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:21.554516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e1f84-58ce-4843-af06-d49286f93fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:21.555896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e1f84-58ce-4843-af06-d49286f93fed None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:21.557987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-39a37e24-538d-4672-aa56-6ff92af8e59e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:21.558982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-39a37e24-538d-4672-aa56-6ff92af8e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:21.567371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 162/323] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:21.572540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e1f84-58ce-4843-af06-d49286f93fed None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:21.629530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 162/324] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:21.648160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a37e24-538d-4672-aa56-6ff92af8e59e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:21.673703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e1f84-58ce-4843-af06-d49286f93fed None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:21.706540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba018a-9825-4fe5-8bc8-3d14cef4ef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:21.707391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba018a-9825-4fe5-8bc8-3d14cef4ef23 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.707729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba018a-9825-4fe5-8bc8-3d14cef4ef23 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.707991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba018a-9825-4fe5-8bc8-3d14cef4ef23 None admin] PATH_INFO: `/v3/users/3aefc1aac978492a955671f2cb2f1f47` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.709195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba018a-9825-4fe5-8bc8-3d14cef4ef23 None admin] RBAC: Authorizing `identity:get_user(user_id=3aefc1aac978492a955671f2cb2f1f47)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:21.710662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba018a-9825-4fe5-8bc8-3d14cef4ef23 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:21.712505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 163/325] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:21 2022] GET /identity/v3/users/3aefc1aac978492a955671f2cb2f1f47 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:21.717777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba018a-9825-4fe5-8bc8-3d14cef4ef23 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:21.753317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a37e24-538d-4672-aa56-6ff92af8e59e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:21.787265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66919b-8022-49ec-be1f-d015e13373d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:21.788073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66919b-8022-49ec-be1f-d015e13373d1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.788353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66919b-8022-49ec-be1f-d015e13373d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.788629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66919b-8022-49ec-be1f-d015e13373d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.789824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66919b-8022-49ec-be1f-d015e13373d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:21.791283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66919b-8022-49ec-be1f-d015e13373d1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:21.793117 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 163/326] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:21.798252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66919b-8022-49ec-be1f-d015e13373d1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:21.813145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba018a-9825-4fe5-8bc8-3d14cef4ef23 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:21.843919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db91a-5d03-470a-bdee-712ec190e0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:21.844569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db91a-5d03-470a-bdee-712ec190e0f4 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.844851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db91a-5d03-470a-bdee-712ec190e0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.845124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db91a-5d03-470a-bdee-712ec190e0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.845996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290db91a-5d03-470a-bdee-712ec190e0f4 None admin] RBAC: Adding query filter params (role.id=fda329dea4e7408c9791a6554d482329, user.id=3aefc1aac978492a955671f2cb2f1f47, scope.system=all) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:21.846307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290db91a-5d03-470a-bdee-712ec190e0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:21.847728 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290db91a-5d03-470a-bdee-712ec190e0f4 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:21.858536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 164/327] 10.222.0.35 () {56 vars in 1308 bytes} [Wed May 4 18:43:21 2022] GET /identity/v3/role_assignments?user.id=3aefc1aac978492a955671f2cb2f1f47&scope.system=all&role.id=fda329dea4e7408c9791a6554d482329 => generated 510 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:21.859864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a90a4-b9f5-4490-9cee-dca2b099dbfc None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.860153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a90a4-b9f5-4490-9cee-dca2b099dbfc None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.860424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a90a4-b9f5-4490-9cee-dca2b099dbfc None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.861889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 165/328] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:21.867787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70555-2f17-47b8-b3b8-0c9a36534f69 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.868093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70555-2f17-47b8-b3b8-0c9a36534f69 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.868362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70555-2f17-47b8-b3b8-0c9a36534f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.886049 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9bd70555-2f17-47b8-b3b8-0c9a36534f69 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:21.887354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9bd70555-2f17-47b8-b3b8-0c9a36534f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:21.894219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66919b-8022-49ec-be1f-d015e13373d1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:21.930821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c98363-c5b3-4dcb-a7ec-760b0f7de16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:21.931499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c98363-c5b3-4dcb-a7ec-760b0f7de16a None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:21.931771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c98363-c5b3-4dcb-a7ec-760b0f7de16a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:21.932038 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c98363-c5b3-4dcb-a7ec-760b0f7de16a None admin] PATH_INFO: `/v3/groups` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:21.932735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c98363-c5b3-4dcb-a7ec-760b0f7de16a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:21.934202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c98363-c5b3-4dcb-a7ec-760b0f7de16a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:21.949936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 164/329] 10.222.0.35 () {60 vars in 1134 bytes} [Wed May 4 18:43:21 2022] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:43:21.958661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 166/330] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:21.982074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c98363-c5b3-4dcb-a7ec-760b0f7de16a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:22.092752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c98363-c5b3-4dcb-a7ec-760b0f7de16a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:22.129996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c022e-f255-4bdf-b379-79283efb4704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:22.130816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c022e-f255-4bdf-b379-79283efb4704 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:22.131098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c022e-f255-4bdf-b379-79283efb4704 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:22.131373 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c022e-f255-4bdf-b379-79283efb4704 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:22.141579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c022e-f255-4bdf-b379-79283efb4704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-1e1c022e-f255-4bdf-b379-79283efb4704 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:22.149324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:22.150403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:22.151439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 165/331] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:22.156539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd70555-2f17-47b8-b3b8-0c9a36534f69 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:22.257773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd70555-2f17-47b8-b3b8-0c9a36534f69 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:22.291521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22381216-28c7-4c76-be34-5c3da792a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:22.292197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22381216-28c7-4c76-be34-5c3da792a16c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:22.292480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22381216-28c7-4c76-be34-5c3da792a16c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:22.292754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22381216-28c7-4c76-be34-5c3da792a16c None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:22.293550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22381216-28c7-4c76-be34-5c3da792a16c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:22.293857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22381216-28c7-4c76-be34-5c3da792a16c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:22.295242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22381216-28c7-4c76-be34-5c3da792a16c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:22.303794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 167/332] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:22.309269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c022e-f255-4bdf-b379-79283efb4704 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:22.413211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c022e-f255-4bdf-b379-79283efb4704 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:22.452251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52fd6b-5d48-4742-aa36-27516e2ae6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:22.453188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52fd6b-5d48-4742-aa36-27516e2ae6a3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:22.453502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52fd6b-5d48-4742-aa36-27516e2ae6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:22.453775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52fd6b-5d48-4742-aa36-27516e2ae6a3 None admin] PATH_INFO: `/v3/users/e9ef7709e81840efab882d49c7091af5` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:22.455038 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52fd6b-5d48-4742-aa36-27516e2ae6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=e9ef7709e81840efab882d49c7091af5)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:22.456502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52fd6b-5d48-4742-aa36-27516e2ae6a3 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:22.458564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 166/333] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:22 2022] GET /identity/v3/users/e9ef7709e81840efab882d49c7091af5 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:22.464389 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22381216-28c7-4c76-be34-5c3da792a16c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:22.571413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22381216-28c7-4c76-be34-5c3da792a16c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:22.605114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d743b-c5fe-44f6-9b3d-619f3bd658a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:22.606010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d743b-c5fe-44f6-9b3d-619f3bd658a9 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:22.606287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d743b-c5fe-44f6-9b3d-619f3bd658a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:22.606557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d743b-c5fe-44f6-9b3d-619f3bd658a9 None admin] PATH_INFO: `/v3/system/users/e9ef7709e81840efab882d49c7091af5/roles/7e055f7884c84073918d471ba5d53247` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:22.608018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d743b-c5fe-44f6-9b3d-619f3bd658a9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e9ef7709e81840efab882d49c7091af5, role_id=7e055f7884c84073918d471ba5d53247)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:22.609425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d743b-c5fe-44f6-9b3d-619f3bd658a9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:22.617781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 168/334] 10.222.0.35 () {58 vars in 1334 bytes} [Wed May 4 18:43:22 2022] PUT /identity/v3/system/users/e9ef7709e81840efab882d49c7091af5/roles/7e055f7884c84073918d471ba5d53247 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:43:24.547381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017504f6-0670-422a-8f87-32b0924eaca9 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:24.547889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017504f6-0670-422a-8f87-32b0924eaca9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:24.547964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017504f6-0670-422a-8f87-32b0924eaca9 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:24.549310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 167/335] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:24.554791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbac4d4-b3fc-419c-bb16-ac9298ecdb88 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:24.555303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbac4d4-b3fc-419c-bb16-ac9298ecdb88 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:24.555456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbac4d4-b3fc-419c-bb16-ac9298ecdb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:24.579211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-bfbac4d4-b3fc-419c-bb16-ac9298ecdb88 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:24.580393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-bfbac4d4-b3fc-419c-bb16-ac9298ecdb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:24.666169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 169/336] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:24.697139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017504f6-0670-422a-8f87-32b0924eaca9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:24.815039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017504f6-0670-422a-8f87-32b0924eaca9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:24.856653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a743ee-fd19-48ce-95a3-87070951e23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:24.857509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a743ee-fd19-48ce-95a3-87070951e23b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:24.857790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a743ee-fd19-48ce-95a3-87070951e23b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:24.858065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a743ee-fd19-48ce-95a3-87070951e23b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:24.868578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a743ee-fd19-48ce-95a3-87070951e23b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-60a743ee-fd19-48ce-95a3-87070951e23b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:24.876526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:24.878567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:24.880508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 168/337] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:24.885323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbac4d4-b3fc-419c-bb16-ac9298ecdb88 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:25.025376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbac4d4-b3fc-419c-bb16-ac9298ecdb88 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:25.064185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590caca2-a166-4e34-b1cc-0ef36625503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:25.064862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590caca2-a166-4e34-b1cc-0ef36625503d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:25.065188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590caca2-a166-4e34-b1cc-0ef36625503d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:25.065458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590caca2-a166-4e34-b1cc-0ef36625503d None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:25.066182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590caca2-a166-4e34-b1cc-0ef36625503d None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:25.066478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590caca2-a166-4e34-b1cc-0ef36625503d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:25.067941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590caca2-a166-4e34-b1cc-0ef36625503d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:25.076369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 170/338] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:25.086408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a743ee-fd19-48ce-95a3-87070951e23b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:25.202954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a743ee-fd19-48ce-95a3-87070951e23b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:25.244738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d62ffa-3597-428e-a015-98b65a557ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:25.245433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d62ffa-3597-428e-a015-98b65a557ed4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:25.245720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d62ffa-3597-428e-a015-98b65a557ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:25.245994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d62ffa-3597-428e-a015-98b65a557ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:25.316883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d62ffa-3597-428e-a015-98b65a557ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:25.318359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d62ffa-3597-428e-a015-98b65a557ed4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:25.421597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 169/339] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:25.428890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590caca2-a166-4e34-b1cc-0ef36625503d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:25.541429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18c413-eafc-4747-bf1b-a64a2113b031 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:25.541748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18c413-eafc-4747-bf1b-a64a2113b031 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:25.541984 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18c413-eafc-4747-bf1b-a64a2113b031 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:25.543690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 170/340] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:25.554865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33711cf-5bc0-4691-bdb4-32d1bbe6e377 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:25.555608 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33711cf-5bc0-4691-bdb4-32d1bbe6e377 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:25.555608 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33711cf-5bc0-4691-bdb4-32d1bbe6e377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:25.592949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590caca2-a166-4e34-b1cc-0ef36625503d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:25.593588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a33711cf-5bc0-4691-bdb4-32d1bbe6e377 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:25.594625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a33711cf-5bc0-4691-bdb4-32d1bbe6e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:25.634374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce9dd2-f3f6-4ed9-99ac-dfb9780f360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:25.635257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce9dd2-f3f6-4ed9-99ac-dfb9780f360d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:25.635535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce9dd2-f3f6-4ed9-99ac-dfb9780f360d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:25.635806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce9dd2-f3f6-4ed9-99ac-dfb9780f360d None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:25.639237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce9dd2-f3f6-4ed9-99ac-dfb9780f360d None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:25.640686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce9dd2-f3f6-4ed9-99ac-dfb9780f360d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:25.642446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 171/341] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:25 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:25.668674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce9dd2-f3f6-4ed9-99ac-dfb9780f360d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:25.697702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 171/342] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:25.702711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56af21-c918-4548-9b83-cefdfdd30c36 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:25.702999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56af21-c918-4548-9b83-cefdfdd30c36 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:25.703273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56af21-c918-4548-9b83-cefdfdd30c36 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:25.704616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 172/343] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:25.741220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56af21-c918-4548-9b83-cefdfdd30c36 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:25.827183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce9dd2-f3f6-4ed9-99ac-dfb9780f360d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:25.871954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6481f5-78cc-4e23-bbb8-6798adfc9700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:25.872794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6481f5-78cc-4e23-bbb8-6798adfc9700 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:25.873073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6481f5-78cc-4e23-bbb8-6798adfc9700 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:25.873360 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6481f5-78cc-4e23-bbb8-6798adfc9700 None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:25.884248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6481f5-78cc-4e23-bbb8-6798adfc9700 None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:25.885759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6481f5-78cc-4e23-bbb8-6798adfc9700 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:25.888500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 172/344] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:25 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:25.889753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6cfc7-aba3-4516-832d-5d9209508126 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:25.890035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6cfc7-aba3-4516-832d-5d9209508126 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:25.890310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6cfc7-aba3-4516-832d-5d9209508126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:25.899696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56af21-c918-4548-9b83-cefdfdd30c36 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:25.918621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-2db6cfc7-aba3-4516-832d-5d9209508126 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:25.919802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-2db6cfc7-aba3-4516-832d-5d9209508126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:25.935806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49eb1-08b4-4530-9399-71672a0929d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:25.936620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49eb1-08b4-4530-9399-71672a0929d4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:25.936891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49eb1-08b4-4530-9399-71672a0929d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:25.937156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49eb1-08b4-4530-9399-71672a0929d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:25.958021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49eb1-08b4-4530-9399-71672a0929d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-6eb49eb1-08b4-4530-9399-71672a0929d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:25.966113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:25.968261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:25.970399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 173/345] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:25.978398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49eb1-08b4-4530-9399-71672a0929d4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:26.036111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 173/346] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:26.036979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6cfc7-aba3-4516-832d-5d9209508126 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:26.121392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49eb1-08b4-4530-9399-71672a0929d4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:26.167051 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcb3f3-1766-470c-ab3d-0e993fef6ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:26.167637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb3f3-1766-470c-ab3d-0e993fef6ec5 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.167866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6cfc7-aba3-4516-832d-5d9209508126 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:26.168030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb3f3-1766-470c-ab3d-0e993fef6ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.168189 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb3f3-1766-470c-ab3d-0e993fef6ec5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.168993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcb3f3-1766-470c-ab3d-0e993fef6ec5 None admin] RBAC: Adding query filter params (group.id=34747f7cac2b41e6b38888ed20ac1026, role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:26.170400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcb3f3-1766-470c-ab3d-0e993fef6ec5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:26.171843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcb3f3-1766-470c-ab3d-0e993fef6ec5 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:26.178028 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 174/347] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:25 2022] GET /identity/v3/role_assignments?group.id=34747f7cac2b41e6b38888ed20ac1026&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=fda329dea4e7408c9791a6554d482329 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:26.179381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342231ce-8a23-4bc0-9a56-97fdbd4152bf None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.179666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342231ce-8a23-4bc0-9a56-97fdbd4152bf None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.179936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342231ce-8a23-4bc0-9a56-97fdbd4152bf None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.181676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 175/348] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:26.182405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342231ce-8a23-4bc0-9a56-97fdbd4152bf None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:26.221065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19324bb-7460-4638-ae03-1c61cadfd991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:26.221963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19324bb-7460-4638-ae03-1c61cadfd991 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.222250 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19324bb-7460-4638-ae03-1c61cadfd991 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.222524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19324bb-7460-4638-ae03-1c61cadfd991 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.224137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19324bb-7460-4638-ae03-1c61cadfd991 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:26.224474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19324bb-7460-4638-ae03-1c61cadfd991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:26.226370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19324bb-7460-4638-ae03-1c61cadfd991 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:26.237604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 174/349] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:26.239035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee541056-46c5-4099-bceb-93c9d860680e None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.239327 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee541056-46c5-4099-bceb-93c9d860680e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.239980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee541056-46c5-4099-bceb-93c9d860680e None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.242065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 175/350] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:26.243332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3cbac-0f11-4783-8ec2-9ff5a304f9a0 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.243778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3cbac-0f11-4783-8ec2-9ff5a304f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.244064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3cbac-0f11-4783-8ec2-9ff5a304f9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.271309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-52e3cbac-0f11-4783-8ec2-9ff5a304f9a0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:26.272499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-52e3cbac-0f11-4783-8ec2-9ff5a304f9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:26.323427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342231ce-8a23-4bc0-9a56-97fdbd4152bf None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:26.346877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 176/351] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:26.348472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7676fd-f2b7-4924-9f49-4d1436c05ea2 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.348755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7676fd-f2b7-4924-9f49-4d1436c05ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.349028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7676fd-f2b7-4924-9f49-4d1436c05ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.366465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-4b7676fd-f2b7-4924-9f49-4d1436c05ea2 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:26.367701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4b7676fd-f2b7-4924-9f49-4d1436c05ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:26.367958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012f36d-6af7-4022-9f01-f1094f7423fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:26.368832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012f36d-6af7-4022-9f01-f1094f7423fa None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.369108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012f36d-6af7-4022-9f01-f1094f7423fa None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.369402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012f36d-6af7-4022-9f01-f1094f7423fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.391252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012f36d-6af7-4022-9f01-f1094f7423fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-b012f36d-6af7-4022-9f01-f1094f7423fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:26.403525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:26.405720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 176/352] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:26.407657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012f36d-6af7-4022-9f01-f1094f7423fa None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:26.460416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 177/353] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:26.461472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7676fd-f2b7-4924-9f49-4d1436c05ea2 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:26.539429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012f36d-6af7-4022-9f01-f1094f7423fa None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:26.565867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7676fd-f2b7-4924-9f49-4d1436c05ea2 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:26.577194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470da91-0a32-4ca2-84a5-257611349ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:26.578082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470da91-0a32-4ca2-84a5-257611349ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.578481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470da91-0a32-4ca2-84a5-257611349ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.578854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470da91-0a32-4ca2-84a5-257611349ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.601266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95606462-62fd-45f0-b5e4-e1bc439d9b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:26.602729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95606462-62fd-45f0-b5e4-e1bc439d9b10 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.603148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95606462-62fd-45f0-b5e4-e1bc439d9b10 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.603675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95606462-62fd-45f0-b5e4-e1bc439d9b10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.614761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95606462-62fd-45f0-b5e4-e1bc439d9b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-95606462-62fd-45f0-b5e4-e1bc439d9b10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:26.622836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:26.623736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 18:43:26.624544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:26.627608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 178/354] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:26.628691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95606462-62fd-45f0-b5e4-e1bc439d9b10 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:26.655953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470da91-0a32-4ca2-84a5-257611349ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:26.657587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470da91-0a32-4ca2-84a5-257611349ca0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:26.726613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95606462-62fd-45f0-b5e4-e1bc439d9b10 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:26.765965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1e9ac-e293-4112-92cc-9a0d5f22a7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:26.766752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1e9ac-e293-4112-92cc-9a0d5f22a7f8 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.767099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1e9ac-e293-4112-92cc-9a0d5f22a7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.767444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1e9ac-e293-4112-92cc-9a0d5f22a7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.768266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1e9ac-e293-4112-92cc-9a0d5f22a7f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:26.768581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1e9ac-e293-4112-92cc-9a0d5f22a7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:26.770032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1e9ac-e293-4112-92cc-9a0d5f22a7f8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:26.773891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 177/355] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:26.774655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470da91-0a32-4ca2-84a5-257611349ca0 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:26.779194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 179/356] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:26.780245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1e9ac-e293-4112-92cc-9a0d5f22a7f8 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:26.903608 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470da91-0a32-4ca2-84a5-257611349ca0 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:26.907609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1e9ac-e293-4112-92cc-9a0d5f22a7f8 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:26.948338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e96af-e54d-46b9-9f4e-15b8603483af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:26.949747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e96af-e54d-46b9-9f4e-15b8603483af None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.950099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e96af-e54d-46b9-9f4e-15b8603483af None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.950444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e96af-e54d-46b9-9f4e-15b8603483af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.954932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ce2a9-4b59-47ec-97f4-56a9465b8b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:26.955600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ce2a9-4b59-47ec-97f4-56a9465b8b85 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.955882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ce2a9-4b59-47ec-97f4-56a9465b8b85 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.956155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ce2a9-4b59-47ec-97f4-56a9465b8b85 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.956910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ce2a9-4b59-47ec-97f4-56a9465b8b85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:26.957217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ce2a9-4b59-47ec-97f4-56a9465b8b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:26.958709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ce2a9-4b59-47ec-97f4-56a9465b8b85 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:26.961139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e96af-e54d-46b9-9f4e-15b8603483af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:26.968191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 180/357] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:26.969549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e1599-a872-4d6e-9c22-66e6e6759b44 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:26.969835 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e1599-a872-4d6e-9c22-66e6e6759b44 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:26.970114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e1599-a872-4d6e-9c22-66e6e6759b44 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:26.971322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 181/358] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-719e96af-e54d-46b9-9f4e-15b8603483af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:26.971843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:26.972692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:26.974003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:26.974623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e1599-a872-4d6e-9c22-66e6e6759b44 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:26.978539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 178/359] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:26.979798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e96af-e54d-46b9-9f4e-15b8603483af None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:27.105147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e96af-e54d-46b9-9f4e-15b8603483af None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:27.123449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e1599-a872-4d6e-9c22-66e6e6759b44 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:27.160068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eb188-1776-438f-af06-49938dbf708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:27.160772 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eb188-1776-438f-af06-49938dbf708f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.161048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eb188-1776-438f-af06-49938dbf708f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.161342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eb188-1776-438f-af06-49938dbf708f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:27.168815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b761-df54-42c6-ad33-f065bc55884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:27.171252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b761-df54-42c6-ad33-f065bc55884f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.171252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b761-df54-42c6-ad33-f065bc55884f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.171252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b761-df54-42c6-ad33-f065bc55884f None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:27.171607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942b761-df54-42c6-ad33-f065bc55884f None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:27.173152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942b761-df54-42c6-ad33-f065bc55884f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:27.175897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 182/360] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:26 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:27.176893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b761-df54-42c6-ad33-f065bc55884f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:27.254255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eb188-1776-438f-af06-49938dbf708f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:27.255698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eb188-1776-438f-af06-49938dbf708f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:27.300789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b761-df54-42c6-ad33-f065bc55884f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:27.342391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c721-2ce5-4fd2-a3a6-e3fe825dc7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:27.343278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c721-2ce5-4fd2-a3a6-e3fe825dc7a6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.343551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c721-2ce5-4fd2-a3a6-e3fe825dc7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.343821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c721-2ce5-4fd2-a3a6-e3fe825dc7a6 None admin] PATH_INFO: `/v3/users/e9ef7709e81840efab882d49c7091af5` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:27.345014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238c721-2ce5-4fd2-a3a6-e3fe825dc7a6 None admin] RBAC: Authorizing `identity:get_user(user_id=e9ef7709e81840efab882d49c7091af5)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:27.346613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238c721-2ce5-4fd2-a3a6-e3fe825dc7a6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:27.348536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 183/361] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:43:27 2022] GET /identity/v3/users/e9ef7709e81840efab882d49c7091af5 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:27.349583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494141-c6fd-40e5-a219-3d375bed2e30 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.349863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494141-c6fd-40e5-a219-3d375bed2e30 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.350135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494141-c6fd-40e5-a219-3d375bed2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:27.367308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-55494141-c6fd-40e5-a219-3d375bed2e30 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:27.368493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-55494141-c6fd-40e5-a219-3d375bed2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:27.375711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 179/362] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:27.376819 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eb188-1776-438f-af06-49938dbf708f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:27.448768 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 184/363] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:27.449537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55494141-c6fd-40e5-a219-3d375bed2e30 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:27.531541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eb188-1776-438f-af06-49938dbf708f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:27.571281 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55494141-c6fd-40e5-a219-3d375bed2e30 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:27.572157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110bb52-a427-4db5-824d-935f9ce19d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:27.572836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110bb52-a427-4db5-824d-935f9ce19d06 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.573187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110bb52-a427-4db5-824d-935f9ce19d06 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.577836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110bb52-a427-4db5-824d-935f9ce19d06 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:27.577836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110bb52-a427-4db5-824d-935f9ce19d06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:27.577836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110bb52-a427-4db5-824d-935f9ce19d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:27.577836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110bb52-a427-4db5-824d-935f9ce19d06 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:27.587357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 180/364] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:27.588422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110bb52-a427-4db5-824d-935f9ce19d06 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:27.620118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a569-0894-400a-a08c-9aaa0b8ba85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:27.621187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a569-0894-400a-a08c-9aaa0b8ba85a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.621807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a569-0894-400a-a08c-9aaa0b8ba85a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.622082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a569-0894-400a-a08c-9aaa0b8ba85a None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:27.624448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181a569-0894-400a-a08c-9aaa0b8ba85a None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:27.626293 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181a569-0894-400a-a08c-9aaa0b8ba85a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:27.627923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 185/365] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:27 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:27.628688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a569-0894-400a-a08c-9aaa0b8ba85a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:27.711910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110bb52-a427-4db5-824d-935f9ce19d06 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:27.749214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a569-0894-400a-a08c-9aaa0b8ba85a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:27.753696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e39d-d28c-4485-97df-21a9f5dbd7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:27.753833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e39d-d28c-4485-97df-21a9f5dbd7d3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.754085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e39d-d28c-4485-97df-21a9f5dbd7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.754399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e39d-d28c-4485-97df-21a9f5dbd7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:27.755237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e39d-d28c-4485-97df-21a9f5dbd7d3 None admin] RBAC: Adding query filter params (role.id=7e055f7884c84073918d471ba5d53247, user.id=e9ef7709e81840efab882d49c7091af5, scope.system=all) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:27.755548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e39d-d28c-4485-97df-21a9f5dbd7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:27.756981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e39d-d28c-4485-97df-21a9f5dbd7d3 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:27.771973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 181/366] 10.222.0.35 () {56 vars in 1308 bytes} [Wed May 4 18:43:27 2022] GET /identity/v3/role_assignments?user.id=e9ef7709e81840efab882d49c7091af5&scope.system=all&role.id=7e055f7884c84073918d471ba5d53247 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:27.773895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e39d-d28c-4485-97df-21a9f5dbd7d3 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:27.793742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1992-5b14-4317-a76a-501ce805c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:27.794919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1992-5b14-4317-a76a-501ce805c6d7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.795357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1992-5b14-4317-a76a-501ce805c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.795802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1992-5b14-4317-a76a-501ce805c6d7 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:27.797122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc1992-5b14-4317-a76a-501ce805c6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:27.798652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc1992-5b14-4317-a76a-501ce805c6d7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:27.800420 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 186/367] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:27 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:27.802829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1992-5b14-4317-a76a-501ce805c6d7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:27.891750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e39d-d28c-4485-97df-21a9f5dbd7d3 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:27.913637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1992-5b14-4317-a76a-501ce805c6d7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:27.926442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c563b6-fe1a-4457-b8d0-c1c6ca18935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:27.927265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c563b6-fe1a-4457-b8d0-c1c6ca18935e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.927546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c563b6-fe1a-4457-b8d0-c1c6ca18935e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.927820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c563b6-fe1a-4457-b8d0-c1c6ca18935e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:27.940883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c563b6-fe1a-4457-b8d0-c1c6ca18935e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-f4c563b6-fe1a-4457-b8d0-c1c6ca18935e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:27.949219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:27.950469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:27.951384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 182/368] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:43:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:27.952115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c563b6-fe1a-4457-b8d0-c1c6ca18935e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:27.953781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ddef3-2e4c-4859-a048-e8930b1aba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:27.954616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ddef3-2e4c-4859-a048-e8930b1aba6b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:27.955068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ddef3-2e4c-4859-a048-e8930b1aba6b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:27.955482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ddef3-2e4c-4859-a048-e8930b1aba6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.025395 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ddef3-2e4c-4859-a048-e8930b1aba6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:28.027101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ddef3-2e4c-4859-a048-e8930b1aba6b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:28.062155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c563b6-fe1a-4457-b8d0-c1c6ca18935e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:28.100342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d10eb-801f-4da4-8f13-83fc93c97182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:28.101380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d10eb-801f-4da4-8f13-83fc93c97182 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.101814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d10eb-801f-4da4-8f13-83fc93c97182 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.102225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d10eb-801f-4da4-8f13-83fc93c97182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.103217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d10eb-801f-4da4-8f13-83fc93c97182 None admin] RBAC: Adding query filter params (group.id=34747f7cac2b41e6b38888ed20ac1026, role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:28.103675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d10eb-801f-4da4-8f13-83fc93c97182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:28.105393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d10eb-801f-4da4-8f13-83fc93c97182 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:28.118565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 183/369] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:27 2022] GET /identity/v3/role_assignments?group.id=34747f7cac2b41e6b38888ed20ac1026&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=812e67b7a9204b8f925c8e613b2209de => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:28.118822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d10eb-801f-4da4-8f13-83fc93c97182 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:28.153603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 187/370] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:28.158456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ddef3-2e4c-4859-a048-e8930b1aba6b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:28.257100 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d10eb-801f-4da4-8f13-83fc93c97182 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:28.289664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ddef3-2e4c-4859-a048-e8930b1aba6b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:28.308177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe3779-331e-4fef-b7af-9f2be6939db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:28.309379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe3779-331e-4fef-b7af-9f2be6939db3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.309817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe3779-331e-4fef-b7af-9f2be6939db3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.310254 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe3779-331e-4fef-b7af-9f2be6939db3 None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.311646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe3779-331e-4fef-b7af-9f2be6939db3 None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:28.314259 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe3779-331e-4fef-b7af-9f2be6939db3 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:28.317152 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 184/371] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:28 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:28.318493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe3779-331e-4fef-b7af-9f2be6939db3 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:28.326370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2becdc9-c202-47ba-81b6-a696732cc558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:28.327164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2becdc9-c202-47ba-81b6-a696732cc558 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.328208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2becdc9-c202-47ba-81b6-a696732cc558 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.328578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2becdc9-c202-47ba-81b6-a696732cc558 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.329486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2becdc9-c202-47ba-81b6-a696732cc558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:28.330305 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2becdc9-c202-47ba-81b6-a696732cc558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:28.331946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2becdc9-c202-47ba-81b6-a696732cc558 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:28.340515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 188/372] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:28.341499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2becdc9-c202-47ba-81b6-a696732cc558 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:28.429917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe3779-331e-4fef-b7af-9f2be6939db3 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:28.473602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2becdc9-c202-47ba-81b6-a696732cc558 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:28.475213 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8592a18-d85b-4f6e-bf90-6a56ea83c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:28.477607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8592a18-d85b-4f6e-bf90-6a56ea83c297 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.478186 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8592a18-d85b-4f6e-bf90-6a56ea83c297 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.478674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8592a18-d85b-4f6e-bf90-6a56ea83c297 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.480307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8592a18-d85b-4f6e-bf90-6a56ea83c297 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:28.482068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8592a18-d85b-4f6e-bf90-6a56ea83c297 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:28.484905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 185/373] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:28 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:28.486650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8592a18-d85b-4f6e-bf90-6a56ea83c297 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:28.515620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbbd38-1117-4e54-92dc-3001330df13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:28.516279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbbd38-1117-4e54-92dc-3001330df13e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.516636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbbd38-1117-4e54-92dc-3001330df13e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.516820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbbd38-1117-4e54-92dc-3001330df13e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.519095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbbd38-1117-4e54-92dc-3001330df13e None admin] RBAC: Adding query filter params (group.id=34747f7cac2b41e6b38888ed20ac1026, role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:28.519299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbbd38-1117-4e54-92dc-3001330df13e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:28.520769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbbd38-1117-4e54-92dc-3001330df13e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:28.526925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 189/374] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:28 2022] GET /identity/v3/role_assignments?group.id=34747f7cac2b41e6b38888ed20ac1026&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=fda329dea4e7408c9791a6554d482329 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:28.527643 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbbd38-1117-4e54-92dc-3001330df13e None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:28.613102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8592a18-d85b-4f6e-bf90-6a56ea83c297 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:28.652139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27677-6cb7-4b05-93ce-8caefb5eefba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:28.653637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27677-6cb7-4b05-93ce-8caefb5eefba None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.654288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27677-6cb7-4b05-93ce-8caefb5eefba None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.654762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27677-6cb7-4b05-93ce-8caefb5eefba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.716027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbbd38-1117-4e54-92dc-3001330df13e None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:28.746446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c27677-6cb7-4b05-93ce-8caefb5eefba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:28.749091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c27677-6cb7-4b05-93ce-8caefb5eefba None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:28.753260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859aece-abea-4a77-8c8b-bd7f526f1a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:28.753997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859aece-abea-4a77-8c8b-bd7f526f1a36 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.757317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859aece-abea-4a77-8c8b-bd7f526f1a36 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.757317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859aece-abea-4a77-8c8b-bd7f526f1a36 None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.757317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859aece-abea-4a77-8c8b-bd7f526f1a36 None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:28.757625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859aece-abea-4a77-8c8b-bd7f526f1a36 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:28.759589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 190/375] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:28 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:28.760920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05972d-6a64-42cb-a31d-904007448aef None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.761207 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05972d-6a64-42cb-a31d-904007448aef None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.761506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05972d-6a64-42cb-a31d-904007448aef None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.762970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 191/376] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:28.766120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05972d-6a64-42cb-a31d-904007448aef None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:28.875102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 186/377] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:28.876382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b755cc-60c4-44a6-a54b-4f7a62bb44c1 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.876674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b755cc-60c4-44a6-a54b-4f7a62bb44c1 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.876947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b755cc-60c4-44a6-a54b-4f7a62bb44c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.892703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05972d-6a64-42cb-a31d-904007448aef None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:28.894528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-48b755cc-60c4-44a6-a54b-4f7a62bb44c1 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:28.895747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-48b755cc-60c4-44a6-a54b-4f7a62bb44c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:28.927046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d6a81-8c96-4eae-a50e-2f1aef37891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:28.927719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6a81-8c96-4eae-a50e-2f1aef37891c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:28.928107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6a81-8c96-4eae-a50e-2f1aef37891c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:28.928433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6a81-8c96-4eae-a50e-2f1aef37891c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:28.929226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d6a81-8c96-4eae-a50e-2f1aef37891c None admin] RBAC: Adding query filter params (group.id=34747f7cac2b41e6b38888ed20ac1026, role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:28.929587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d6a81-8c96-4eae-a50e-2f1aef37891c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:28.931029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d6a81-8c96-4eae-a50e-2f1aef37891c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:28.937026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 192/378] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:28 2022] GET /identity/v3/role_assignments?group.id=34747f7cac2b41e6b38888ed20ac1026&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=812e67b7a9204b8f925c8e613b2209de => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:28.937950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d6a81-8c96-4eae-a50e-2f1aef37891c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:28.964475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 187/379] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:28.987479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b755cc-60c4-44a6-a54b-4f7a62bb44c1 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:29.043846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d6a81-8c96-4eae-a50e-2f1aef37891c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:29.078747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954593c6-6494-49fa-acfb-d7b9f24ccaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:29.079634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954593c6-6494-49fa-acfb-d7b9f24ccaad None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:29.079917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954593c6-6494-49fa-acfb-d7b9f24ccaad None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:29.080196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954593c6-6494-49fa-acfb-d7b9f24ccaad None admin] PATH_INFO: `/v3/projects/a4308e1d2b884e0c9079dd2577f0b370` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:29.081479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954593c6-6494-49fa-acfb-d7b9f24ccaad None admin] RBAC: Authorizing `identity:get_project(project_id=a4308e1d2b884e0c9079dd2577f0b370)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:29.083004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954593c6-6494-49fa-acfb-d7b9f24ccaad None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:29.085077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 193/380] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:28 2022] GET /identity/v3/projects/a4308e1d2b884e0c9079dd2577f0b370 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:29.090126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954593c6-6494-49fa-acfb-d7b9f24ccaad None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:29.093160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b755cc-60c4-44a6-a54b-4f7a62bb44c1 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:29.131253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb398b4-8c8c-4cf6-8533-a48f482ef3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:29.132006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb398b4-8c8c-4cf6-8533-a48f482ef3bb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:29.132293 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb398b4-8c8c-4cf6-8533-a48f482ef3bb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:29.132559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb398b4-8c8c-4cf6-8533-a48f482ef3bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:29.144649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb398b4-8c8c-4cf6-8533-a48f482ef3bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-5eb398b4-8c8c-4cf6-8533-a48f482ef3bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:29.152863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:29.155205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:29.157235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 188/381] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:29.165349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb398b4-8c8c-4cf6-8533-a48f482ef3bb None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:29.201192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954593c6-6494-49fa-acfb-d7b9f24ccaad None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:29.236208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dbf7a-d6bf-433e-8050-fec80b5fbd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:29.237081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dbf7a-d6bf-433e-8050-fec80b5fbd5a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:29.237404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dbf7a-d6bf-433e-8050-fec80b5fbd5a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:29.237683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dbf7a-d6bf-433e-8050-fec80b5fbd5a None admin] PATH_INFO: `/v3/groups/fd59d36d0921489b9b513fd269103e3f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:29.242730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dbf7a-d6bf-433e-8050-fec80b5fbd5a None admin] RBAC: Authorizing `identity:get_group(group_id=fd59d36d0921489b9b513fd269103e3f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:29.244199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dbf7a-d6bf-433e-8050-fec80b5fbd5a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:29.246215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 194/382] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:29 2022] GET /identity/v3/groups/fd59d36d0921489b9b513fd269103e3f => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:29.254280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dbf7a-d6bf-433e-8050-fec80b5fbd5a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:29.264509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb398b4-8c8c-4cf6-8533-a48f482ef3bb None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:29.297748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439e2c1-ee8b-4874-85c8-23f2c562793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:29.298417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439e2c1-ee8b-4874-85c8-23f2c562793d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:29.298701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439e2c1-ee8b-4874-85c8-23f2c562793d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:29.298978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439e2c1-ee8b-4874-85c8-23f2c562793d None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:29.299748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439e2c1-ee8b-4874-85c8-23f2c562793d None admin] RBAC: Adding query filter params (name=member) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:29.300053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439e2c1-ee8b-4874-85c8-23f2c562793d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:29.301504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439e2c1-ee8b-4874-85c8-23f2c562793d None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:29.310245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 189/383] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:29.315906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439e2c1-ee8b-4874-85c8-23f2c562793d None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:29.376306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dbf7a-d6bf-433e-8050-fec80b5fbd5a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:29.413795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b2414-5f14-4038-9703-2ec38d954b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:29.414382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b2414-5f14-4038-9703-2ec38d954b8b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:29.414671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b2414-5f14-4038-9703-2ec38d954b8b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:29.414949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b2414-5f14-4038-9703-2ec38d954b8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:29.415805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b2414-5f14-4038-9703-2ec38d954b8b None admin] RBAC: Adding query filter params (group.id=fd59d36d0921489b9b513fd269103e3f, role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=a4308e1d2b884e0c9079dd2577f0b370) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:29.416107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b2414-5f14-4038-9703-2ec38d954b8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:29.418042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b2414-5f14-4038-9703-2ec38d954b8b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:29.440901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 195/384] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:29 2022] GET /identity/v3/role_assignments?group.id=fd59d36d0921489b9b513fd269103e3f&scope.project.id=a4308e1d2b884e0c9079dd2577f0b370&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:29.471023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439e2c1-ee8b-4874-85c8-23f2c562793d None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:29.520807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0de1b-38be-49c4-ba57-c20bab56adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:29.521808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0de1b-38be-49c4-ba57-c20bab56adcc None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:29.522085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0de1b-38be-49c4-ba57-c20bab56adcc None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:29.522396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0de1b-38be-49c4-ba57-c20bab56adcc None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:29.530285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0de1b-38be-49c4-ba57-c20bab56adcc None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:29.531935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0de1b-38be-49c4-ba57-c20bab56adcc None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:29.534309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 190/385] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:29 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:29.540235 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b2414-5f14-4038-9703-2ec38d954b8b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:29.679834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b2414-5f14-4038-9703-2ec38d954b8b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:29.713374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75340134-24de-4375-af4b-c08487ea6b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:29.714249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75340134-24de-4375-af4b-c08487ea6b71 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:29.714597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75340134-24de-4375-af4b-c08487ea6b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:29.714913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75340134-24de-4375-af4b-c08487ea6b71 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:29.715987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75340134-24de-4375-af4b-c08487ea6b71 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:29.717453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75340134-24de-4375-af4b-c08487ea6b71 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:29.719447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 196/386] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:29 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:29.725641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0de1b-38be-49c4-ba57-c20bab56adcc None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:29.828897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0de1b-38be-49c4-ba57-c20bab56adcc None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:29.864361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83713d-a286-4e8f-9e4a-c2cf3e8c6855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:29.865252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83713d-a286-4e8f-9e4a-c2cf3e8c6855 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:29.865572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83713d-a286-4e8f-9e4a-c2cf3e8c6855 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:29.865849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83713d-a286-4e8f-9e4a-c2cf3e8c6855 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/groups/34747f7cac2b41e6b38888ed20ac1026/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:29.867800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83713d-a286-4e8f-9e4a-c2cf3e8c6855 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de0bf8f19d4705b1534c7d42f2e99a, group_id=34747f7cac2b41e6b38888ed20ac1026, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:29.869252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83713d-a286-4e8f-9e4a-c2cf3e8c6855 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:29.886717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 191/387] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 4 18:43:29 2022] PUT /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/groups/34747f7cac2b41e6b38888ed20ac1026/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:31.047721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536c9f-6eb7-4c74-bb27-f59d6d809b3d None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:31.048243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536c9f-6eb7-4c74-bb27-f59d6d809b3d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:31.048243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536c9f-6eb7-4c74-bb27-f59d6d809b3d None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:31.049949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 197/388] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:31.055442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431abf9-76e3-487f-8f64-58d35e85a318 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:31.055836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431abf9-76e3-487f-8f64-58d35e85a318 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:31.056001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431abf9-76e3-487f-8f64-58d35e85a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:31.078703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-e431abf9-76e3-487f-8f64-58d35e85a318 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:31.079916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e431abf9-76e3-487f-8f64-58d35e85a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:31.173534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 192/389] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:31.207893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50536c9f-6eb7-4c74-bb27-f59d6d809b3d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:31.354067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50536c9f-6eb7-4c74-bb27-f59d6d809b3d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:31.398005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9fcdd-39a2-458e-ad52-e85aed4be349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:31.398830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9fcdd-39a2-458e-ad52-e85aed4be349 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:31.399104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9fcdd-39a2-458e-ad52-e85aed4be349 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:31.399375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9fcdd-39a2-458e-ad52-e85aed4be349 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:31.411083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9fcdd-39a2-458e-ad52-e85aed4be349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-2ab9fcdd-39a2-458e-ad52-e85aed4be349 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:31.419330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:31.420284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:31.421334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 198/390] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:31.426731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431abf9-76e3-487f-8f64-58d35e85a318 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:31.599696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431abf9-76e3-487f-8f64-58d35e85a318 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:31.651401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1cc2b-655a-44d3-a631-77ab867b3e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:31.652001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1cc2b-655a-44d3-a631-77ab867b3e5e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:31.652284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1cc2b-655a-44d3-a631-77ab867b3e5e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:31.652559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1cc2b-655a-44d3-a631-77ab867b3e5e None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:31.653342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1cc2b-655a-44d3-a631-77ab867b3e5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:31.653656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1cc2b-655a-44d3-a631-77ab867b3e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:31.655034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1cc2b-655a-44d3-a631-77ab867b3e5e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:31.659072 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34bf7e-d420-453d-95b1-62ef6f420708 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:31.659358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34bf7e-d420-453d-95b1-62ef6f420708 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:31.659633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34bf7e-d420-453d-95b1-62ef6f420708 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:31.661260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 199/391] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:31.666337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb12a09-175b-4193-8882-9310dbee12d1 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:31.666625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb12a09-175b-4193-8882-9310dbee12d1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:31.666907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb12a09-175b-4193-8882-9310dbee12d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:31.668870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 193/392] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:31.674569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1cc2b-655a-44d3-a631-77ab867b3e5e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:31.694534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-abb12a09-175b-4193-8882-9310dbee12d1 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:31.695894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-abb12a09-175b-4193-8882-9310dbee12d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:31.816251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 200/393] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:31.817121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1cc2b-655a-44d3-a631-77ab867b3e5e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:31.849956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb12a09-175b-4193-8882-9310dbee12d1 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:31.855421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599639e-518e-4900-8274-4fe0e1a1e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:31.856291 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599639e-518e-4900-8274-4fe0e1a1e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:31.856569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599639e-518e-4900-8274-4fe0e1a1e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:31.856837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599639e-518e-4900-8274-4fe0e1a1e6c7 None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:31.865313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599639e-518e-4900-8274-4fe0e1a1e6c7 None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:31.865313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599639e-518e-4900-8274-4fe0e1a1e6c7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:31.865313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 194/394] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:31 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:31.866393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599639e-518e-4900-8274-4fe0e1a1e6c7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:31.966198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb12a09-175b-4193-8882-9310dbee12d1 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.001031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599639e-518e-4900-8274-4fe0e1a1e6c7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.011577 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69ded-9882-4273-a23d-2d4c78c484bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.012690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69ded-9882-4273-a23d-2d4c78c484bf None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.013237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69ded-9882-4273-a23d-2d4c78c484bf None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.013544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69ded-9882-4273-a23d-2d4c78c484bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.026419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69ded-9882-4273-a23d-2d4c78c484bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:32.035218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa6bd8-353d-4b14-ad18-71da5ab0c273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-72e69ded-9882-4273-a23d-2d4c78c484bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:32.035995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:32.036955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:32.037785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:32.038388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa6bd8-353d-4b14-ad18-71da5ab0c273 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.038388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa6bd8-353d-4b14-ad18-71da5ab0c273 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.038388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa6bd8-353d-4b14-ad18-71da5ab0c273 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.038570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 201/395] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:32.039153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7553-24f2-4521-8a20-18c87c12abe6 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.039315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7553-24f2-4521-8a20-18c87c12abe6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.039465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7553-24f2-4521-8a20-18c87c12abe6 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.040880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 202/396] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:32.042125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa6bd8-353d-4b14-ad18-71da5ab0c273 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:32.043648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa6bd8-353d-4b14-ad18-71da5ab0c273 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:32.046137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325e0e-a796-4e23-ad78-0cc3e7e20584 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.046416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325e0e-a796-4e23-ad78-0cc3e7e20584 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.046685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325e0e-a796-4e23-ad78-0cc3e7e20584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.049683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 195/397] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:31 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:32.051833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa6bd8-353d-4b14-ad18-71da5ab0c273 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.064543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-68325e0e-a796-4e23-ad78-0cc3e7e20584 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:32.066320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-68325e0e-a796-4e23-ad78-0cc3e7e20584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:32.132359 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 203/398] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:32.138234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325e0e-a796-4e23-ad78-0cc3e7e20584 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.168753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa6bd8-353d-4b14-ad18-71da5ab0c273 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.203198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd997fa7-f866-4b11-9ca4-ce0d763039e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.204091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd997fa7-f866-4b11-9ca4-ce0d763039e6 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.204375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd997fa7-f866-4b11-9ca4-ce0d763039e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.204653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd997fa7-f866-4b11-9ca4-ce0d763039e6 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/groups/34747f7cac2b41e6b38888ed20ac1026/roles/812e67b7a9204b8f925c8e613b2209de` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.206957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd997fa7-f866-4b11-9ca4-ce0d763039e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de0bf8f19d4705b1534c7d42f2e99a, group_id=34747f7cac2b41e6b38888ed20ac1026, role_id=812e67b7a9204b8f925c8e613b2209de)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:32.208476 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd997fa7-f866-4b11-9ca4-ce0d763039e6 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:32.233700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 196/399] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 4 18:43:32 2022] PUT /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a/groups/34747f7cac2b41e6b38888ed20ac1026/roles/812e67b7a9204b8f925c8e613b2209de => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:32.233700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd997fa7-f866-4b11-9ca4-ce0d763039e6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.254338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325e0e-a796-4e23-ad78-0cc3e7e20584 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.292473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38503fdf-5b2d-437d-bbdc-1d10a0c647eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.293226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503fdf-5b2d-437d-bbdc-1d10a0c647eb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.293555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503fdf-5b2d-437d-bbdc-1d10a0c647eb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.294157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38503fdf-5b2d-437d-bbdc-1d10a0c647eb None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.295116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38503fdf-5b2d-437d-bbdc-1d10a0c647eb None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:32.295433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38503fdf-5b2d-437d-bbdc-1d10a0c647eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:32.297005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38503fdf-5b2d-437d-bbdc-1d10a0c647eb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:32.306891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 204/400] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:32.308417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af77fc-ff66-45d0-80c9-53325e807ba1 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.308752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af77fc-ff66-45d0-80c9-53325e807ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.309032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af77fc-ff66-45d0-80c9-53325e807ba1 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.314806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 205/401] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:32.316322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af77fc-ff66-45d0-80c9-53325e807ba1 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.363456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd997fa7-f866-4b11-9ca4-ce0d763039e6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.407485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bc61f-8cb4-4983-a72c-b7169e06a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.408630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bc61f-8cb4-4983-a72c-b7169e06a667 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.409174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bc61f-8cb4-4983-a72c-b7169e06a667 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.409472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bc61f-8cb4-4983-a72c-b7169e06a667 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.423735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bc61f-8cb4-4983-a72c-b7169e06a667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-1c0bc61f-8cb4-4983-a72c-b7169e06a667 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:32.432701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:32.433728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:32.434517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 197/402] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:32.435724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af77fc-ff66-45d0-80c9-53325e807ba1 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.436302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0302b-6e79-4214-adca-4f8261d6beda None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.436302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0302b-6e79-4214-adca-4f8261d6beda None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.436600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0302b-6e79-4214-adca-4f8261d6beda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.466142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7dd0302b-6e79-4214-adca-4f8261d6beda None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:32.466725 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7dd0302b-6e79-4214-adca-4f8261d6beda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:32.479865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897cfff-86ac-4f98-8f44-3921db25105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.480736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897cfff-86ac-4f98-8f44-3921db25105d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.481020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897cfff-86ac-4f98-8f44-3921db25105d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.481311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897cfff-86ac-4f98-8f44-3921db25105d None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.482505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897cfff-86ac-4f98-8f44-3921db25105d None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:32.484004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897cfff-86ac-4f98-8f44-3921db25105d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:32.485773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 206/403] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:32 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:32.486371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897cfff-86ac-4f98-8f44-3921db25105d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.536541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 198/404] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:32.537437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0302b-6e79-4214-adca-4f8261d6beda None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.615004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897cfff-86ac-4f98-8f44-3921db25105d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.632329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0302b-6e79-4214-adca-4f8261d6beda None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.651612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a344877-d6dd-48a1-b4b5-ccceb0366a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.652288 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a344877-d6dd-48a1-b4b5-ccceb0366a0f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.652556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a344877-d6dd-48a1-b4b5-ccceb0366a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.652832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a344877-d6dd-48a1-b4b5-ccceb0366a0f None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.653622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a344877-d6dd-48a1-b4b5-ccceb0366a0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:32.653930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a344877-d6dd-48a1-b4b5-ccceb0366a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:32.655300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a344877-d6dd-48a1-b4b5-ccceb0366a0f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:32.667685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 207/405] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:32.667685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a344877-d6dd-48a1-b4b5-ccceb0366a0f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.667891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf4f43-bca9-46db-aa8c-ca97ebb8c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.667981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4f43-bca9-46db-aa8c-ca97ebb8c6de None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.668461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4f43-bca9-46db-aa8c-ca97ebb8c6de None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.668559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4f43-bca9-46db-aa8c-ca97ebb8c6de None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.670235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf4f43-bca9-46db-aa8c-ca97ebb8c6de None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:32.671177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf4f43-bca9-46db-aa8c-ca97ebb8c6de None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:32.673004 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 199/406] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:32 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:32.677185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa79a4-8223-430b-9a69-f3ce92cd8d33 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.677185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa79a4-8223-430b-9a69-f3ce92cd8d33 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.677185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa79a4-8223-430b-9a69-f3ce92cd8d33 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.677185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 200/407] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:32.680791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa79a4-8223-430b-9a69-f3ce92cd8d33 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.763838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a344877-d6dd-48a1-b4b5-ccceb0366a0f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.778865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa79a4-8223-430b-9a69-f3ce92cd8d33 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.795723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527b471-b4bd-4ffb-a936-9111d4201b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.796602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527b471-b4bd-4ffb-a936-9111d4201b9a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.796895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527b471-b4bd-4ffb-a936-9111d4201b9a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.797174 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527b471-b4bd-4ffb-a936-9111d4201b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.807011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527b471-b4bd-4ffb-a936-9111d4201b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:32.814013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85a7ca-8c00-431a-b446-4666a9aa97ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-4527b471-b4bd-4ffb-a936-9111d4201b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:32.814675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:32.815721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:32.816735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:32.817841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85a7ca-8c00-431a-b446-4666a9aa97ed None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.818132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85a7ca-8c00-431a-b446-4666a9aa97ed None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.818410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85a7ca-8c00-431a-b446-4666a9aa97ed None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.819633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85a7ca-8c00-431a-b446-4666a9aa97ed None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:32.820911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 208/408] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:43:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:32.821207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85a7ca-8c00-431a-b446-4666a9aa97ed None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:32.821742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527b471-b4bd-4ffb-a936-9111d4201b9a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.827418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 201/409] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:32 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:32.827418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f73a-fc72-4d7e-81a5-e05cdea387f2 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.827418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f73a-fc72-4d7e-81a5-e05cdea387f2 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.827418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f73a-fc72-4d7e-81a5-e05cdea387f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.842439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c8b7f73a-fc72-4d7e-81a5-e05cdea387f2 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:32.843600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c8b7f73a-fc72-4d7e-81a5-e05cdea387f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:32.909626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 202/410] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:32.910512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7f73a-fc72-4d7e-81a5-e05cdea387f2 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:32.924696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527b471-b4bd-4ffb-a936-9111d4201b9a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:32.956669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b178ddf-49df-47e6-ad17-f7b752a1639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:32.957662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b178ddf-49df-47e6-ad17-f7b752a1639b None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:32.957953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b178ddf-49df-47e6-ad17-f7b752a1639b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:32.958230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b178ddf-49df-47e6-ad17-f7b752a1639b None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/groups/34747f7cac2b41e6b38888ed20ac1026/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:32.960211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b178ddf-49df-47e6-ad17-f7b752a1639b None admin] RBAC: Authorizing `identity:create_grant(project_id=a6737563b3a84f8385cbad6b6c06f54f, group_id=34747f7cac2b41e6b38888ed20ac1026, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:32.961689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b178ddf-49df-47e6-ad17-f7b752a1639b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:32.975326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 209/411] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 4 18:43:32 2022] PUT /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/groups/34747f7cac2b41e6b38888ed20ac1026/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:32.976134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b178ddf-49df-47e6-ad17-f7b752a1639b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:33.040088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7f73a-fc72-4d7e-81a5-e05cdea387f2 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:33.084356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b178ddf-49df-47e6-ad17-f7b752a1639b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:33.085492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf03ec-424c-4d8f-9ce8-4d7b29a68984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:33.086364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf03ec-424c-4d8f-9ce8-4d7b29a68984 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:33.086808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf03ec-424c-4d8f-9ce8-4d7b29a68984 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:33.087306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf03ec-424c-4d8f-9ce8-4d7b29a68984 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:33.088277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf03ec-424c-4d8f-9ce8-4d7b29a68984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:33.088776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf03ec-424c-4d8f-9ce8-4d7b29a68984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:33.090399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf03ec-424c-4d8f-9ce8-4d7b29a68984 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:33.100076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 203/412] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:33.101272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf03ec-424c-4d8f-9ce8-4d7b29a68984 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:33.121186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50243cc1-bcfe-44f0-9886-03806403ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:33.122106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50243cc1-bcfe-44f0-9886-03806403ad6a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:33.122385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50243cc1-bcfe-44f0-9886-03806403ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:33.122657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50243cc1-bcfe-44f0-9886-03806403ad6a None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:33.124169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50243cc1-bcfe-44f0-9886-03806403ad6a None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:33.126024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50243cc1-bcfe-44f0-9886-03806403ad6a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:33.133313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 210/413] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:32 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:33.133313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50243cc1-bcfe-44f0-9886-03806403ad6a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:33.227803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf03ec-424c-4d8f-9ce8-4d7b29a68984 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:33.254918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50243cc1-bcfe-44f0-9886-03806403ad6a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:33.265575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46513cc-8a30-4021-9c95-4e064b714a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:33.266742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46513cc-8a30-4021-9c95-4e064b714a0f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:33.267227 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46513cc-8a30-4021-9c95-4e064b714a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:33.267743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46513cc-8a30-4021-9c95-4e064b714a0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:33.278657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46513cc-8a30-4021-9c95-4e064b714a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-f46513cc-8a30-4021-9c95-4e064b714a0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:33.286833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:33.287729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:33.288533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:33.295911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf32ee7-c595-4471-b379-33d6d0418d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:33.295911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf32ee7-c595-4471-b379-33d6d0418d3e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:33.295911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf32ee7-c595-4471-b379-33d6d0418d3e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:33.295911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf32ee7-c595-4471-b379-33d6d0418d3e None admin] PATH_INFO: `/v3/groups/fd59d36d0921489b9b513fd269103e3f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:33.296253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 204/414] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:33.296253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46513cc-8a30-4021-9c95-4e064b714a0f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:33.296377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf32ee7-c595-4471-b379-33d6d0418d3e None admin] RBAC: Authorizing `identity:get_group(group_id=fd59d36d0921489b9b513fd269103e3f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:33.296900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf32ee7-c595-4471-b379-33d6d0418d3e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:33.298698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 211/415] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:33 2022] GET /identity/v3/groups/fd59d36d0921489b9b513fd269103e3f => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:33.299519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf32ee7-c595-4471-b379-33d6d0418d3e None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:33.398519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46513cc-8a30-4021-9c95-4e064b714a0f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:33.416439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf32ee7-c595-4471-b379-33d6d0418d3e None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:33.433348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a49aec-0df1-4db9-bd77-739f7bf735d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:33.434570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49aec-0df1-4db9-bd77-739f7bf735d0 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:33.435048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49aec-0df1-4db9-bd77-739f7bf735d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:33.435549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49aec-0df1-4db9-bd77-739f7bf735d0 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/groups/34747f7cac2b41e6b38888ed20ac1026/roles/812e67b7a9204b8f925c8e613b2209de` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:33.438047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a49aec-0df1-4db9-bd77-739f7bf735d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6737563b3a84f8385cbad6b6c06f54f, group_id=34747f7cac2b41e6b38888ed20ac1026, role_id=812e67b7a9204b8f925c8e613b2209de)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:33.439699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a49aec-0df1-4db9-bd77-739f7bf735d0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:33.449842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cadd8-19a1-40e6-8db4-3c4f95c55a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:33.450542 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cadd8-19a1-40e6-8db4-3c4f95c55a83 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:33.450823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cadd8-19a1-40e6-8db4-3c4f95c55a83 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:33.451093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cadd8-19a1-40e6-8db4-3c4f95c55a83 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:33.451901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cadd8-19a1-40e6-8db4-3c4f95c55a83 None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:33.452251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cadd8-19a1-40e6-8db4-3c4f95c55a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:33.453674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cadd8-19a1-40e6-8db4-3c4f95c55a83 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:33.458575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 205/416] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 4 18:43:33 2022] PUT /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f/groups/34747f7cac2b41e6b38888ed20ac1026/roles/812e67b7a9204b8f925c8e613b2209de => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:33.459687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a49aec-0df1-4db9-bd77-739f7bf735d0 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:33.462350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 212/417] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:33.482423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cadd8-19a1-40e6-8db4-3c4f95c55a83 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:33.573789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a49aec-0df1-4db9-bd77-739f7bf735d0 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:33.588864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cadd8-19a1-40e6-8db4-3c4f95c55a83 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:33.609043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3385e-95db-469d-8cfb-494690f6bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:33.610184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3385e-95db-469d-8cfb-494690f6bc3f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:33.610699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3385e-95db-469d-8cfb-494690f6bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:33.611141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3385e-95db-469d-8cfb-494690f6bc3f None admin] PATH_INFO: `/v3/projects/a4308e1d2b884e0c9079dd2577f0b370` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:33.612495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3385e-95db-469d-8cfb-494690f6bc3f None admin] RBAC: Authorizing `identity:get_project(project_id=a4308e1d2b884e0c9079dd2577f0b370)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:33.614249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3385e-95db-469d-8cfb-494690f6bc3f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:33.616215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 206/418] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:33 2022] GET /identity/v3/projects/a4308e1d2b884e0c9079dd2577f0b370 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:33.622302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3385e-95db-469d-8cfb-494690f6bc3f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:33.644726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5d25-5699-4160-80f0-062b2a9d078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:33.646083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5d25-5699-4160-80f0-062b2a9d078e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:33.646533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5d25-5699-4160-80f0-062b2a9d078e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:33.646813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5d25-5699-4160-80f0-062b2a9d078e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:33.730568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5d25-5699-4160-80f0-062b2a9d078e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:33.732112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5d25-5699-4160-80f0-062b2a9d078e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:33.762089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3385e-95db-469d-8cfb-494690f6bc3f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:33.801565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c437c-0f63-4df8-b300-52c14072c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:33.802697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c437c-0f63-4df8-b300-52c14072c6dc None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:33.802806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c437c-0f63-4df8-b300-52c14072c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:33.803090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c437c-0f63-4df8-b300-52c14072c6dc None admin] PATH_INFO: `/v3/projects/a4308e1d2b884e0c9079dd2577f0b370/groups/fd59d36d0921489b9b513fd269103e3f/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:33.805120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c437c-0f63-4df8-b300-52c14072c6dc None admin] RBAC: Authorizing `identity:create_grant(project_id=a4308e1d2b884e0c9079dd2577f0b370, group_id=fd59d36d0921489b9b513fd269103e3f, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:33.806871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c437c-0f63-4df8-b300-52c14072c6dc None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:33.831503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 207/419] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 4 18:43:33 2022] PUT /identity/v3/projects/a4308e1d2b884e0c9079dd2577f0b370/groups/fd59d36d0921489b9b513fd269103e3f/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:33.846464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 213/420] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:33.853342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c437c-0f63-4df8-b300-52c14072c6dc None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:33.982043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c437c-0f63-4df8-b300-52c14072c6dc None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:34.027799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b82b96-c1d6-4f4f-a3e6-ed5664475032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:34.028697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b82b96-c1d6-4f4f-a3e6-ed5664475032 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:34.028979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b82b96-c1d6-4f4f-a3e6-ed5664475032 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:34.029256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b82b96-c1d6-4f4f-a3e6-ed5664475032 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:34.030998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b82b96-c1d6-4f4f-a3e6-ed5664475032 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:34.032468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b82b96-c1d6-4f4f-a3e6-ed5664475032 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:34.035477 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 208/421] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:33 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:34.042007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5d25-5699-4160-80f0-062b2a9d078e None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:34.140658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5d25-5699-4160-80f0-062b2a9d078e None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:34.179138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b79ee-d5bd-4a25-b70b-cc38cb5163fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:34.179999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b79ee-d5bd-4a25-b70b-cc38cb5163fb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:34.180275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b79ee-d5bd-4a25-b70b-cc38cb5163fb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:34.180667 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b79ee-d5bd-4a25-b70b-cc38cb5163fb None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:34.181925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b79ee-d5bd-4a25-b70b-cc38cb5163fb None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:34.183427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b79ee-d5bd-4a25-b70b-cc38cb5163fb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:34.185339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 214/422] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:34 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:34.191172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b82b96-c1d6-4f4f-a3e6-ed5664475032 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:34.320307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b82b96-c1d6-4f4f-a3e6-ed5664475032 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:34.366848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5cf89-9337-41a1-b3a6-b1ee777057cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:34.367501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5cf89-9337-41a1-b3a6-b1ee777057cf None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:34.367785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5cf89-9337-41a1-b3a6-b1ee777057cf None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:34.368058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5cf89-9337-41a1-b3a6-b1ee777057cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:34.368891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5cf89-9337-41a1-b3a6-b1ee777057cf None admin] RBAC: Adding query filter params (group.id=34747f7cac2b41e6b38888ed20ac1026, role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:34.369202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5cf89-9337-41a1-b3a6-b1ee777057cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:34.370651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5cf89-9337-41a1-b3a6-b1ee777057cf None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:34.381654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 209/423] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:34 2022] GET /identity/v3/role_assignments?group.id=34747f7cac2b41e6b38888ed20ac1026&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=fda329dea4e7408c9791a6554d482329 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:34.600302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc51f29-5181-471e-b1d3-749553246b71 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:34.600696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc51f29-5181-471e-b1d3-749553246b71 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:34.600869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc51f29-5181-471e-b1d3-749553246b71 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:34.602501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 215/424] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:34.607744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f019ced-0305-472a-a5c1-2b5dcf329aff None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:34.608039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f019ced-0305-472a-a5c1-2b5dcf329aff None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:34.608314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f019ced-0305-472a-a5c1-2b5dcf329aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:34.634425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8f019ced-0305-472a-a5c1-2b5dcf329aff None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:34.635651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8f019ced-0305-472a-a5c1-2b5dcf329aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:34.719257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 210/425] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:34.744133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc51f29-5181-471e-b1d3-749553246b71 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:34.848691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc51f29-5181-471e-b1d3-749553246b71 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:34.887130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e5ef3-1916-402d-b6a6-60f8916941a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:34.887977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e5ef3-1916-402d-b6a6-60f8916941a7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:34.888262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e5ef3-1916-402d-b6a6-60f8916941a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:34.888534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e5ef3-1916-402d-b6a6-60f8916941a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:34.900412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e5ef3-1916-402d-b6a6-60f8916941a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-3d1e5ef3-1916-402d-b6a6-60f8916941a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:34.908870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:34.909827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:34.910699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 216/426] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:34.916427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f019ced-0305-472a-a5c1-2b5dcf329aff None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:35.025978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f019ced-0305-472a-a5c1-2b5dcf329aff None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:35.065168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec011fa-7cd0-4ced-b15f-3e880064ba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:35.065892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec011fa-7cd0-4ced-b15f-3e880064ba85 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:35.066171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec011fa-7cd0-4ced-b15f-3e880064ba85 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:35.066445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec011fa-7cd0-4ced-b15f-3e880064ba85 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:35.067328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec011fa-7cd0-4ced-b15f-3e880064ba85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:35.067638 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec011fa-7cd0-4ced-b15f-3e880064ba85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:35.069032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec011fa-7cd0-4ced-b15f-3e880064ba85 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:35.077569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 211/427] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:35.082848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e5ef3-1916-402d-b6a6-60f8916941a7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:35.194191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e5ef3-1916-402d-b6a6-60f8916941a7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:35.231196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545dd3-084b-4411-b58a-ae678dda2a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:35.231854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545dd3-084b-4411-b58a-ae678dda2a47 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:35.232135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545dd3-084b-4411-b58a-ae678dda2a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:35.232410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545dd3-084b-4411-b58a-ae678dda2a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:35.308724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c545dd3-084b-4411-b58a-ae678dda2a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:35.310227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c545dd3-084b-4411-b58a-ae678dda2a47 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:35.419375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 217/428] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:35.424962 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec011fa-7cd0-4ced-b15f-3e880064ba85 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:35.534257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec011fa-7cd0-4ced-b15f-3e880064ba85 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:35.568307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bad2f8-1676-4eac-ab5f-c631d822f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:35.569102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bad2f8-1676-4eac-ab5f-c631d822f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:35.569408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bad2f8-1676-4eac-ab5f-c631d822f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:35.569690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bad2f8-1676-4eac-ab5f-c631d822f2e2 None admin] PATH_INFO: `/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:35.570886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bad2f8-1676-4eac-ab5f-c631d822f2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de0bf8f19d4705b1534c7d42f2e99a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:35.572319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bad2f8-1676-4eac-ab5f-c631d822f2e2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:35.574451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 212/429] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:35 2022] GET /identity/v3/projects/a1de0bf8f19d4705b1534c7d42f2e99a => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:35.579572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545dd3-084b-4411-b58a-ae678dda2a47 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:35.643531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b3ef8-e28e-4e0c-9b05-8a8b0aa35f0b None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:35.643837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b3ef8-e28e-4e0c-9b05-8a8b0aa35f0b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:35.644249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b3ef8-e28e-4e0c-9b05-8a8b0aa35f0b None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:35.646026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 213/430] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:35.650976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc92718-3d77-4111-988b-9f5b33dee9c9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:35.651332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc92718-3d77-4111-988b-9f5b33dee9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:35.651685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc92718-3d77-4111-988b-9f5b33dee9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:35.668936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-fbc92718-3d77-4111-988b-9f5b33dee9c9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:35.670400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-fbc92718-3d77-4111-988b-9f5b33dee9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:35.687627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545dd3-084b-4411-b58a-ae678dda2a47 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:35.727205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c3b9-6667-4ed2-9ced-4090fc8e42be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:35.728835 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c3b9-6667-4ed2-9ced-4090fc8e42be None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:35.729319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c3b9-6667-4ed2-9ced-4090fc8e42be None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:35.729768 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c3b9-6667-4ed2-9ced-4090fc8e42be None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:35.731128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66c3b9-6667-4ed2-9ced-4090fc8e42be None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:35.733495 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66c3b9-6667-4ed2-9ced-4090fc8e42be None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:35.736371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 218/431] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:35 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:35.742013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c3b9-6667-4ed2-9ced-4090fc8e42be None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:35.746257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 214/432] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:35.769759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc92718-3d77-4111-988b-9f5b33dee9c9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:35.844616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c3b9-6667-4ed2-9ced-4090fc8e42be None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:35.878223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75663aa-f46d-4018-8404-193526c15030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:35.878876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75663aa-f46d-4018-8404-193526c15030 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:35.879185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75663aa-f46d-4018-8404-193526c15030 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:35.879456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75663aa-f46d-4018-8404-193526c15030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:35.880294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75663aa-f46d-4018-8404-193526c15030 None admin] RBAC: Adding query filter params (group.id=34747f7cac2b41e6b38888ed20ac1026, role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:35.880605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75663aa-f46d-4018-8404-193526c15030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:35.882067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75663aa-f46d-4018-8404-193526c15030 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:35.888165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 219/433] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:35 2022] GET /identity/v3/role_assignments?group.id=34747f7cac2b41e6b38888ed20ac1026&scope.project.id=a1de0bf8f19d4705b1534c7d42f2e99a&role.id=812e67b7a9204b8f925c8e613b2209de => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:35.890422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc92718-3d77-4111-988b-9f5b33dee9c9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:35.930354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edc403-c371-42a8-84ba-409d3ac1b204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:35.931184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edc403-c371-42a8-84ba-409d3ac1b204 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:35.931469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edc403-c371-42a8-84ba-409d3ac1b204 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:35.931742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edc403-c371-42a8-84ba-409d3ac1b204 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:35.943735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edc403-c371-42a8-84ba-409d3ac1b204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-27edc403-c371-42a8-84ba-409d3ac1b204 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:35.951816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:35.952807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 18:43:35.953649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:35.957688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 215/434] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:35.962454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75663aa-f46d-4018-8404-193526c15030 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:36.073048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75663aa-f46d-4018-8404-193526c15030 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:36.106984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497540d-d200-4384-b0b7-4cefb44bd129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:36.107627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497540d-d200-4384-b0b7-4cefb44bd129 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.107912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497540d-d200-4384-b0b7-4cefb44bd129 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.108188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497540d-d200-4384-b0b7-4cefb44bd129 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.108955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497540d-d200-4384-b0b7-4cefb44bd129 None admin] RBAC: Adding query filter params (name=member) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:36.109262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497540d-d200-4384-b0b7-4cefb44bd129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:36.110660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497540d-d200-4384-b0b7-4cefb44bd129 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:36.119965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 220/435] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:43:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:36.126416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edc403-c371-42a8-84ba-409d3ac1b204 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:36.169886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798559b-601e-49a1-92e8-7087fb7fd9cc None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.170186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798559b-601e-49a1-92e8-7087fb7fd9cc None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.170433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798559b-601e-49a1-92e8-7087fb7fd9cc None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.172065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 221/436] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:36.179412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4724b-14c7-45b8-94e3-137dad04123c None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.179702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4724b-14c7-45b8-94e3-137dad04123c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.179965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4724b-14c7-45b8-94e3-137dad04123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.203813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-8ea4724b-14c7-45b8-94e3-137dad04123c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:36.205830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8ea4724b-14c7-45b8-94e3-137dad04123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:36.236590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edc403-c371-42a8-84ba-409d3ac1b204 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:36.274519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034af48-fb96-431d-815a-b66943126578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:36.275223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034af48-fb96-431d-815a-b66943126578 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.275508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034af48-fb96-431d-815a-b66943126578 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.275770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034af48-fb96-431d-815a-b66943126578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.297328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 222/437] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:36.319683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4724b-14c7-45b8-94e3-137dad04123c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:36.365511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034af48-fb96-431d-815a-b66943126578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:36.366946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034af48-fb96-431d-815a-b66943126578 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:36.429508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4724b-14c7-45b8-94e3-137dad04123c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:36.467553 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 216/438] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:36.468100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22b0fd-2780-426f-a32f-ced7348dfca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:36.468372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22b0fd-2780-426f-a32f-ced7348dfca7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.468666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22b0fd-2780-426f-a32f-ced7348dfca7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.468931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22b0fd-2780-426f-a32f-ced7348dfca7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.473058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034af48-fb96-431d-815a-b66943126578 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:36.478699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22b0fd-2780-426f-a32f-ced7348dfca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-6f22b0fd-2780-426f-a32f-ced7348dfca7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:36.486684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:36.487574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:36.488382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:36.492576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 223/439] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:36.493532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22b0fd-2780-426f-a32f-ced7348dfca7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:36.572258 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034af48-fb96-431d-815a-b66943126578 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:36.586712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22b0fd-2780-426f-a32f-ced7348dfca7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:36.602763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994f31e-79e6-4611-9ede-6826f1d2b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:36.603609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994f31e-79e6-4611-9ede-6826f1d2b0bf None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.603881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994f31e-79e6-4611-9ede-6826f1d2b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.604145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994f31e-79e6-4611-9ede-6826f1d2b0bf None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.607112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994f31e-79e6-4611-9ede-6826f1d2b0bf None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:36.607112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994f31e-79e6-4611-9ede-6826f1d2b0bf None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:36.608928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 217/440] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:36 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:36.609923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5312b-ce61-4eea-8a5f-581edf560ff4 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.610198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5312b-ce61-4eea-8a5f-581edf560ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.610463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5312b-ce61-4eea-8a5f-581edf560ff4 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.611686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 218/441] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:36.614186 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5312b-ce61-4eea-8a5f-581edf560ff4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:36.622658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0850009-fb08-4cb9-aa32-8bef43385fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:36.623298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0850009-fb08-4cb9-aa32-8bef43385fad None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.623573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0850009-fb08-4cb9-aa32-8bef43385fad None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.623845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0850009-fb08-4cb9-aa32-8bef43385fad None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.624888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0850009-fb08-4cb9-aa32-8bef43385fad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:36.625212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0850009-fb08-4cb9-aa32-8bef43385fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:36.626614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0850009-fb08-4cb9-aa32-8bef43385fad None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:36.634861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 224/442] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:36.636072 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c107f7-3871-487d-9210-ef86ae00b00d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.636358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c107f7-3871-487d-9210-ef86ae00b00d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.636627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c107f7-3871-487d-9210-ef86ae00b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.652313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-18c107f7-3871-487d-9210-ef86ae00b00d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:36.653508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-18c107f7-3871-487d-9210-ef86ae00b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:36.708678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5312b-ce61-4eea-8a5f-581edf560ff4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:36.716132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 225/443] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:36.716940 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c107f7-3871-487d-9210-ef86ae00b00d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:36.741055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b9487-331a-4702-ac26-ec1f9adfcfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:36.741991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b9487-331a-4702-ac26-ec1f9adfcfd7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.742304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b9487-331a-4702-ac26-ec1f9adfcfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.742569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b9487-331a-4702-ac26-ec1f9adfcfd7 None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.743874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b9487-331a-4702-ac26-ec1f9adfcfd7 None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:36.745393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b9487-331a-4702-ac26-ec1f9adfcfd7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:36.747018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 219/444] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:36 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:36.747812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b9487-331a-4702-ac26-ec1f9adfcfd7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:36.826958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c107f7-3871-487d-9210-ef86ae00b00d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:36.842233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b9487-331a-4702-ac26-ec1f9adfcfd7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:36.859709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768ab6a-d54e-4b2b-aa69-f14baf375351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:36.860347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768ab6a-d54e-4b2b-aa69-f14baf375351 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.860622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768ab6a-d54e-4b2b-aa69-f14baf375351 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.860890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768ab6a-d54e-4b2b-aa69-f14baf375351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.875321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a609f-8e44-4279-962c-328db7eb2302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:36.876030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a609f-8e44-4279-962c-328db7eb2302 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:36.876307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a609f-8e44-4279-962c-328db7eb2302 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:36.876569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a609f-8e44-4279-962c-328db7eb2302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:36.886266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a609f-8e44-4279-962c-328db7eb2302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-fe4a609f-8e44-4279-962c-328db7eb2302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:36.893763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:36.894670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:36.895493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 220/445] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:36.896146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a609f-8e44-4279-962c-328db7eb2302 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:36.934339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768ab6a-d54e-4b2b-aa69-f14baf375351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:36.935783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768ab6a-d54e-4b2b-aa69-f14baf375351 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:36.989631 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a609f-8e44-4279-962c-328db7eb2302 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:37.023426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf742b7b-078e-4bfc-91a4-60ab49deffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:37.024075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf742b7b-078e-4bfc-91a4-60ab49deffc6 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:37.024357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf742b7b-078e-4bfc-91a4-60ab49deffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:37.024629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf742b7b-078e-4bfc-91a4-60ab49deffc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:37.025492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf742b7b-078e-4bfc-91a4-60ab49deffc6 None admin] RBAC: Adding query filter params (group.id=34747f7cac2b41e6b38888ed20ac1026, role.id=fda329dea4e7408c9791a6554d482329, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:37.025805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf742b7b-078e-4bfc-91a4-60ab49deffc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:37.027238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf742b7b-078e-4bfc-91a4-60ab49deffc6 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:37.033055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 221/446] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:36 2022] GET /identity/v3/role_assignments?group.id=34747f7cac2b41e6b38888ed20ac1026&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=fda329dea4e7408c9791a6554d482329 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:37.037842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 226/447] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:37.038009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf742b7b-078e-4bfc-91a4-60ab49deffc6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:37.042720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768ab6a-d54e-4b2b-aa69-f14baf375351 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:37.144265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768ab6a-d54e-4b2b-aa69-f14baf375351 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:37.145147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf742b7b-078e-4bfc-91a4-60ab49deffc6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:37.178328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa6f9-40ed-45e3-bd36-f348d9fa7cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:37.178554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01459-8f24-40ac-ade7-fb271049b9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:37.179135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01459-8f24-40ac-ade7-fb271049b9e3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:37.179232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa6f9-40ed-45e3-bd36-f348d9fa7cb6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:37.179408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01459-8f24-40ac-ade7-fb271049b9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:37.179501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa6f9-40ed-45e3-bd36-f348d9fa7cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:37.179677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01459-8f24-40ac-ade7-fb271049b9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:37.179768 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa6f9-40ed-45e3-bd36-f348d9fa7cb6 None admin] PATH_INFO: `/v3/projects/a6737563b3a84f8385cbad6b6c06f54f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:37.180431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d01459-8f24-40ac-ade7-fb271049b9e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:37.180810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d01459-8f24-40ac-ade7-fb271049b9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:37.181041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aa6f9-40ed-45e3-bd36-f348d9fa7cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=a6737563b3a84f8385cbad6b6c06f54f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:37.182302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d01459-8f24-40ac-ade7-fb271049b9e3 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:37.182521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aa6f9-40ed-45e3-bd36-f348d9fa7cb6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:37.184433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 227/448] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:37 2022] GET /identity/v3/projects/a6737563b3a84f8385cbad6b6c06f54f => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:37.189987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa6f9-40ed-45e3-bd36-f348d9fa7cb6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:37.194352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 222/449] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:37.200055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01459-8f24-40ac-ade7-fb271049b9e3 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:37.292804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa6f9-40ed-45e3-bd36-f348d9fa7cb6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:37.309670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01459-8f24-40ac-ade7-fb271049b9e3 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:37.326515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece642f-eda5-4df8-a195-ba2aa99c5058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:37.327382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece642f-eda5-4df8-a195-ba2aa99c5058 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:37.327661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece642f-eda5-4df8-a195-ba2aa99c5058 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:37.327937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece642f-eda5-4df8-a195-ba2aa99c5058 None admin] PATH_INFO: `/v3/groups/34747f7cac2b41e6b38888ed20ac1026` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:37.329122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece642f-eda5-4df8-a195-ba2aa99c5058 None admin] RBAC: Authorizing `identity:get_group(group_id=34747f7cac2b41e6b38888ed20ac1026)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:37.330615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece642f-eda5-4df8-a195-ba2aa99c5058 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:37.332849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 228/450] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:37 2022] GET /identity/v3/groups/34747f7cac2b41e6b38888ed20ac1026 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:37.338118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece642f-eda5-4df8-a195-ba2aa99c5058 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:37.349459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6995d-174c-45e7-a769-8bbdaee26d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:37.349667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6995d-174c-45e7-a769-8bbdaee26d1b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:37.351191 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6995d-174c-45e7-a769-8bbdaee26d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:37.351191 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6995d-174c-45e7-a769-8bbdaee26d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:37.420849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6995d-174c-45e7-a769-8bbdaee26d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:37.422265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6995d-174c-45e7-a769-8bbdaee26d1b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:37.433549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece642f-eda5-4df8-a195-ba2aa99c5058 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:37.467463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b8561-be62-46d3-b720-43cf71ac4049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:37.468119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b8561-be62-46d3-b720-43cf71ac4049 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:37.468396 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b8561-be62-46d3-b720-43cf71ac4049 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:37.468663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b8561-be62-46d3-b720-43cf71ac4049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:37.469525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b8561-be62-46d3-b720-43cf71ac4049 None admin] RBAC: Adding query filter params (group.id=34747f7cac2b41e6b38888ed20ac1026, role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=a6737563b3a84f8385cbad6b6c06f54f) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:37.469831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b8561-be62-46d3-b720-43cf71ac4049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:37.471245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b8561-be62-46d3-b720-43cf71ac4049 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:37.476907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 229/451] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:37 2022] GET /identity/v3/role_assignments?group.id=34747f7cac2b41e6b38888ed20ac1026&scope.project.id=a6737563b3a84f8385cbad6b6c06f54f&role.id=812e67b7a9204b8f925c8e613b2209de => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:37.518763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 223/452] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:43:37.524586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b8561-be62-46d3-b720-43cf71ac4049 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:37.628549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b8561-be62-46d3-b720-43cf71ac4049 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:37.663781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e7eb5-9567-48fa-b939-dc52a4bbeb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:37.664647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e7eb5-9567-48fa-b939-dc52a4bbeb04 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:37.664931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e7eb5-9567-48fa-b939-dc52a4bbeb04 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:37.665204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e7eb5-9567-48fa-b939-dc52a4bbeb04 None admin] PATH_INFO: `/v3/projects/a4308e1d2b884e0c9079dd2577f0b370` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:37.666460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e7eb5-9567-48fa-b939-dc52a4bbeb04 None admin] RBAC: Authorizing `identity:get_project(project_id=a4308e1d2b884e0c9079dd2577f0b370)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:37.667898 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e7eb5-9567-48fa-b939-dc52a4bbeb04 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:37.669881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 230/453] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:43:37 2022] GET /identity/v3/projects/a4308e1d2b884e0c9079dd2577f0b370 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:37.675527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6995d-174c-45e7-a769-8bbdaee26d1b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:37.780563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6995d-174c-45e7-a769-8bbdaee26d1b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:37.813531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a1d86-ae5c-46c1-befc-b76f7802c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:37.814411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a1d86-ae5c-46c1-befc-b76f7802c454 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:37.814686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a1d86-ae5c-46c1-befc-b76f7802c454 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:37.814953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a1d86-ae5c-46c1-befc-b76f7802c454 None admin] PATH_INFO: `/v3/groups/fd59d36d0921489b9b513fd269103e3f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:37.816110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a1d86-ae5c-46c1-befc-b76f7802c454 None admin] RBAC: Authorizing `identity:get_group(group_id=fd59d36d0921489b9b513fd269103e3f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:37.817618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a1d86-ae5c-46c1-befc-b76f7802c454 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:37.819567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 224/454] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 4 18:43:37 2022] GET /identity/v3/groups/fd59d36d0921489b9b513fd269103e3f => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:37.825194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e7eb5-9567-48fa-b939-dc52a4bbeb04 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:37.918253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e7eb5-9567-48fa-b939-dc52a4bbeb04 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:37.951914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130966c-0c9f-4cdd-99cc-3ccbddfab375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:37.952504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130966c-0c9f-4cdd-99cc-3ccbddfab375 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:37.952783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130966c-0c9f-4cdd-99cc-3ccbddfab375 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:37.953055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130966c-0c9f-4cdd-99cc-3ccbddfab375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:37.953916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130966c-0c9f-4cdd-99cc-3ccbddfab375 None admin] RBAC: Adding query filter params (group.id=fd59d36d0921489b9b513fd269103e3f, role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=a4308e1d2b884e0c9079dd2577f0b370) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:37.954229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130966c-0c9f-4cdd-99cc-3ccbddfab375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:37.955644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130966c-0c9f-4cdd-99cc-3ccbddfab375 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:37.961436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 231/455] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 4 18:43:37 2022] GET /identity/v3/role_assignments?group.id=fd59d36d0921489b9b513fd269103e3f&scope.project.id=a4308e1d2b884e0c9079dd2577f0b370&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:40.595853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd1936-9849-4b87-b8ca-a18ac03f1b98 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:40.596369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd1936-9849-4b87-b8ca-a18ac03f1b98 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:40.596475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd1936-9849-4b87-b8ca-a18ac03f1b98 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:40.598054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 225/456] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:40.603655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda38875-bb01-44da-b98b-364d7ba3a984 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:40.604477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda38875-bb01-44da-b98b-364d7ba3a984 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:40.604947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda38875-bb01-44da-b98b-364d7ba3a984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:40.630343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-cda38875-bb01-44da-b98b-364d7ba3a984 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:40.631967 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cda38875-bb01-44da-b98b-364d7ba3a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:40.718993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 232/457] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:40.756379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd1936-9849-4b87-b8ca-a18ac03f1b98 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:40.811179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633327-5cda-41e8-8f81-06393aba13fd None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:40.811825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633327-5cda-41e8-8f81-06393aba13fd None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:40.812337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633327-5cda-41e8-8f81-06393aba13fd None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:40.814226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 233/458] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:40.819381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abedb1-68b5-4263-ae0e-b34eb5a0694c None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:40.819953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abedb1-68b5-4263-ae0e-b34eb5a0694c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:40.820419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abedb1-68b5-4263-ae0e-b34eb5a0694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:40.862608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-31abedb1-68b5-4263-ae0e-b34eb5a0694c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:40.864168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-31abedb1-68b5-4263-ae0e-b34eb5a0694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:40.879214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd1936-9849-4b87-b8ca-a18ac03f1b98 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:40.930895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c942cf-6258-4ff6-9ee3-2212074f529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:40.931706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c942cf-6258-4ff6-9ee3-2212074f529f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:40.932005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c942cf-6258-4ff6-9ee3-2212074f529f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:40.932260 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c942cf-6258-4ff6-9ee3-2212074f529f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:40.947484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c942cf-6258-4ff6-9ee3-2212074f529f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:40.948952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c942cf-6258-4ff6-9ee3-2212074f529f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:40.950839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 234/459] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-37c942cf-6258-4ff6-9ee3-2212074f529f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:40.969211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:40.970126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:40.970969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:40.970969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:40.970969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:40.970969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:40.970969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 226/460] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:40.977518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abedb1-68b5-4263-ae0e-b34eb5a0694c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:40.986964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c942cf-6258-4ff6-9ee3-2212074f529f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:41.153890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abedb1-68b5-4263-ae0e-b34eb5a0694c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:41.167952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c942cf-6258-4ff6-9ee3-2212074f529f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:41.210691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f711989-ac08-4aa4-8c74-a7e5c1f15b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:41.211405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f711989-ac08-4aa4-8c74-a7e5c1f15b06 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.211687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f711989-ac08-4aa4-8c74-a7e5c1f15b06 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.211958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f711989-ac08-4aa4-8c74-a7e5c1f15b06 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.212681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f711989-ac08-4aa4-8c74-a7e5c1f15b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:41.212984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f711989-ac08-4aa4-8c74-a7e5c1f15b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:41.214384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f711989-ac08-4aa4-8c74-a7e5c1f15b06 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:41.216708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f366d-5a12-4dc8-bf10-4f66b54ebb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:41.217687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f366d-5a12-4dc8-bf10-4f66b54ebb3f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.218099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f366d-5a12-4dc8-bf10-4f66b54ebb3f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.218521 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f366d-5a12-4dc8-bf10-4f66b54ebb3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.226122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 235/461] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:41.227596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161de6b-6eb7-44d8-b387-b9da145b2ad5 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.228019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161de6b-6eb7-44d8-b387-b9da145b2ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.228429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161de6b-6eb7-44d8-b387-b9da145b2ad5 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.230076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 236/462] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:41.231830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161de6b-6eb7-44d8-b387-b9da145b2ad5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:41.233639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f366d-5a12-4dc8-bf10-4f66b54ebb3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:41.235310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f366d-5a12-4dc8-bf10-4f66b54ebb3f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-6b5f366d-5a12-4dc8-bf10-4f66b54ebb3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:41.257045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:41.257988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:41.258818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:41.258818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:41.258818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:41.258818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:41.261522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 227/463] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:41.263383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf030be-7cb2-4b54-b846-96a18b380edf None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.264080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf030be-7cb2-4b54-b846-96a18b380edf None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.264491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf030be-7cb2-4b54-b846-96a18b380edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.286467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ccf030be-7cb2-4b54-b846-96a18b380edf None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:41.288334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ccf030be-7cb2-4b54-b846-96a18b380edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:41.338254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161de6b-6eb7-44d8-b387-b9da145b2ad5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:41.371284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 228/464] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:41.371707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607d8af-a17f-4e56-891c-890e5f4546f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:41.372115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf030be-7cb2-4b54-b846-96a18b380edf None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:41.372812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607d8af-a17f-4e56-891c-890e5f4546f8 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.373280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607d8af-a17f-4e56-891c-890e5f4546f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.373778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607d8af-a17f-4e56-891c-890e5f4546f8 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.374976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607d8af-a17f-4e56-891c-890e5f4546f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:41.376587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607d8af-a17f-4e56-891c-890e5f4546f8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:41.402311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 237/465] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:43:41 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:43:41.404605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f049-bf0e-48bc-9bbd-57b959db529c None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.405095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f049-bf0e-48bc-9bbd-57b959db529c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.405583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f049-bf0e-48bc-9bbd-57b959db529c None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.408487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 238/466] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:41.409670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1f049-bf0e-48bc-9bbd-57b959db529c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:41.480476 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf030be-7cb2-4b54-b846-96a18b380edf None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:41.518129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779246f6-cbcd-49f4-a444-58edf9eded43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:41.519242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779246f6-cbcd-49f4-a444-58edf9eded43 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.519779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779246f6-cbcd-49f4-a444-58edf9eded43 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.520285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779246f6-cbcd-49f4-a444-58edf9eded43 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.521250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779246f6-cbcd-49f4-a444-58edf9eded43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:41.521782 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779246f6-cbcd-49f4-a444-58edf9eded43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:41.523400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779246f6-cbcd-49f4-a444-58edf9eded43 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:41.542004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1f049-bf0e-48bc-9bbd-57b959db529c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:41.543077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 229/467] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:41.544775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd06be2-ee46-472a-ab36-e2622ffeef22 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.545357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd06be2-ee46-472a-ab36-e2622ffeef22 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.545830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd06be2-ee46-472a-ab36-e2622ffeef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.564090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9fd06be2-ee46-472a-ab36-e2622ffeef22 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:41.565784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9fd06be2-ee46-472a-ab36-e2622ffeef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:41.586412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c0e32-bc0a-4dda-af13-5620d86647bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:41.587228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c0e32-bc0a-4dda-af13-5620d86647bd None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.587505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c0e32-bc0a-4dda-af13-5620d86647bd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.587773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c0e32-bc0a-4dda-af13-5620d86647bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.601584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c0e32-bc0a-4dda-af13-5620d86647bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:41.603271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c0e32-bc0a-4dda-af13-5620d86647bd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-ac9c0e32-bc0a-4dda-af13-5620d86647bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:41.620979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:41.622332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:41.623187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:41.623187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:41.623187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:41.623187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:41.623187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 239/468] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:41.623187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c0e32-bc0a-4dda-af13-5620d86647bd None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:41.647089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 230/469] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:41.648715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd06be2-ee46-472a-ab36-e2622ffeef22 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:41.738415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c0e32-bc0a-4dda-af13-5620d86647bd None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:41.757184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd06be2-ee46-472a-ab36-e2622ffeef22 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:41.772589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa3c63-b3f6-4761-b167-62af9dab7195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:41.773338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa3c63-b3f6-4761-b167-62af9dab7195 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.773625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa3c63-b3f6-4761-b167-62af9dab7195 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.773903 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa3c63-b3f6-4761-b167-62af9dab7195 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.774611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa3c63-b3f6-4761-b167-62af9dab7195 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:41.776037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa3c63-b3f6-4761-b167-62af9dab7195 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:41.791321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d03f0-ef1f-402a-b5d4-e2a75ff81fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:41.792073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d03f0-ef1f-402a-b5d4-e2a75ff81fec None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.792350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d03f0-ef1f-402a-b5d4-e2a75ff81fec None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.792617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d03f0-ef1f-402a-b5d4-e2a75ff81fec None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.793431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d03f0-ef1f-402a-b5d4-e2a75ff81fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:41.793780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d03f0-ef1f-402a-b5d4-e2a75ff81fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:41.795247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d03f0-ef1f-402a-b5d4-e2a75ff81fec None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:41.798034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 240/470] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:43:41 2022] POST /identity/v3/users => generated 248 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:43:41.798984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa3c63-b3f6-4761-b167-62af9dab7195 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:41.808466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 231/471] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:41.814651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d03f0-ef1f-402a-b5d4-e2a75ff81fec None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:41.923176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa3c63-b3f6-4761-b167-62af9dab7195 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:41.929343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d03f0-ef1f-402a-b5d4-e2a75ff81fec None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:41.957446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dbdbf-f33f-4f26-ba04-b83c86ef7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:41.958265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dbdbf-f33f-4f26-ba04-b83c86ef7594 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.958546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dbdbf-f33f-4f26-ba04-b83c86ef7594 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.958864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dbdbf-f33f-4f26-ba04-b83c86ef7594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.965307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc06c8c-215f-4359-b97e-3a6d8b1d6069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:41.966302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc06c8c-215f-4359-b97e-3a6d8b1d6069 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:41.966777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc06c8c-215f-4359-b97e-3a6d8b1d6069 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:41.967301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc06c8c-215f-4359-b97e-3a6d8b1d6069 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:41.968249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc06c8c-215f-4359-b97e-3a6d8b1d6069 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:41.969937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc06c8c-215f-4359-b97e-3a6d8b1d6069 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:41.970650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dbdbf-f33f-4f26-ba04-b83c86ef7594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:41.972220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dbdbf-f33f-4f26-ba04-b83c86ef7594 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-265dbdbf-f33f-4f26-ba04-b83c86ef7594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:42.005468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:42.006432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:42.007283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:42.007283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:42.007283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:42.007283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:42.007283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 241/473] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:42.008467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 232/473] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:43:41 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:43:42.022481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dbdbf-f33f-4f26-ba04-b83c86ef7594 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:42.105475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c8e7-997e-45b3-b62b-701d329505c0 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:42.106112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c8e7-997e-45b3-b62b-701d329505c0 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:42.106581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c8e7-997e-45b3-b62b-701d329505c0 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:42.111341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 233/474] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:42.113874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64bbc1-f8d0-467d-93ea-2f96e7666b61 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:42.114471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64bbc1-f8d0-467d-93ea-2f96e7666b61 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:42.114975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64bbc1-f8d0-467d-93ea-2f96e7666b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:42.149316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9a64bbc1-f8d0-467d-93ea-2f96e7666b61 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:42.149512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dbdbf-f33f-4f26-ba04-b83c86ef7594 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:42.149592 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9a64bbc1-f8d0-467d-93ea-2f96e7666b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:42.183410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a28322-067a-4062-9267-05446a632189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:42.184083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a28322-067a-4062-9267-05446a632189 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:42.184358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a28322-067a-4062-9267-05446a632189 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:42.184635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a28322-067a-4062-9267-05446a632189 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:42.185381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a28322-067a-4062-9267-05446a632189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:42.185688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a28322-067a-4062-9267-05446a632189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:42.187074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a28322-067a-4062-9267-05446a632189 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:42.201274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 242/475] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:42.207857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a28322-067a-4062-9267-05446a632189 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:42.230853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 234/476] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:42.254571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64bbc1-f8d0-467d-93ea-2f96e7666b61 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:42.335441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a28322-067a-4062-9267-05446a632189 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:42.370699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06b6e-e852-4fda-97d1-d3dd31d4118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:42.371541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06b6e-e852-4fda-97d1-d3dd31d4118c None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:42.372612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06b6e-e852-4fda-97d1-d3dd31d4118c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:42.372612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06b6e-e852-4fda-97d1-d3dd31d4118c None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:42.373048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc06b6e-e852-4fda-97d1-d3dd31d4118c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:42.374964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc06b6e-e852-4fda-97d1-d3dd31d4118c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:42.378347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64bbc1-f8d0-467d-93ea-2f96e7666b61 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:42.401479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 243/477] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:43:42 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:43:42.418587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:42.419430 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:42.419806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:42.420172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:42.421093 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:42.422847 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:42.432658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.sql.core [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 18:43:42.432658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 18:43:42.432658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [parameters: {'id': 'c529a82545d242a8874f21d7f7ac9555', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 18:43:42.432658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79826) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application conn.query(q) May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application result.read() May 04 18:43:42.450109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return ref.to_dict() May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:43:42.451238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application next(self.gen) May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application yield resource May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application next(self.gen) May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.session.rollback() May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.force_reraise() May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise self.value May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application session.commit() May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 18:43:42.452382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._prepare_impl() May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.session.flush() May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._flush(objects) May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application compat.raise_( May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application flush_context.execute() May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rec.execute(self) May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 18:43:42.453468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:43:42.454565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application conn.query(q) May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application result.read() May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:43:42.455533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [parameters: {'id': 'c529a82545d242a8874f21d7f7ac9555', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:42.456507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 18:43:42.457986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:42.460004 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 235/478] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 4 18:43:42 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:42.470486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06b6e-e852-4fda-97d1-d3dd31d4118c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:42.612721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06b6e-e852-4fda-97d1-d3dd31d4118c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:42.650013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56811f67-e064-4499-83a8-5c91795d4c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:42.650825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56811f67-e064-4499-83a8-5c91795d4c88 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:42.651101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56811f67-e064-4499-83a8-5c91795d4c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:42.651369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56811f67-e064-4499-83a8-5c91795d4c88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:42.667554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56811f67-e064-4499-83a8-5c91795d4c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-56811f67-e064-4499-83a8-5c91795d4c88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:42.675727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:42.676641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:42.677489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 244/479] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:43:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:42.686375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:42.802875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5433cc-86fa-4e23-9848-57326466b0f4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:42.836620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353159ce-a6b2-478a-b8a1-0cc89e98f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:42.837315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353159ce-a6b2-478a-b8a1-0cc89e98f430 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:42.837596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353159ce-a6b2-478a-b8a1-0cc89e98f430 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:42.837872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353159ce-a6b2-478a-b8a1-0cc89e98f430 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:42.838630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353159ce-a6b2-478a-b8a1-0cc89e98f430 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:42.838938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353159ce-a6b2-478a-b8a1-0cc89e98f430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:42.840314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353159ce-a6b2-478a-b8a1-0cc89e98f430 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:42.848548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 236/480] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:44.007895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a610-50fd-4c55-9c59-66243d24a90a None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.008442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a610-50fd-4c55-9c59-66243d24a90a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.008442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a610-50fd-4c55-9c59-66243d24a90a None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.010024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 245/481] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:44.015313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d35c-7637-4950-a5af-fd697914758f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.015707 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d35c-7637-4950-a5af-fd697914758f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.015889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d35c-7637-4950-a5af-fd697914758f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.032446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c5f6d35c-7637-4950-a5af-fd697914758f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:44.033637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c5f6d35c-7637-4950-a5af-fd697914758f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:44.128702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 237/482] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:44.151440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89a610-50fd-4c55-9c59-66243d24a90a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:44.250566 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89a610-50fd-4c55-9c59-66243d24a90a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:44.282759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261276d1-2a91-4312-a000-7c7c6fac6ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:44.283568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261276d1-2a91-4312-a000-7c7c6fac6ce9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.283846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261276d1-2a91-4312-a000-7c7c6fac6ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.284117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261276d1-2a91-4312-a000-7c7c6fac6ce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.294219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261276d1-2a91-4312-a000-7c7c6fac6ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-261276d1-2a91-4312-a000-7c7c6fac6ce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:44.302171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:44.304242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:44.306183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 246/483] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:44.310434 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d35c-7637-4950-a5af-fd697914758f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:44.429559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d35c-7637-4950-a5af-fd697914758f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:44.469028 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33030e-bf1b-40b1-bf95-cb636be769eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:44.469741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33030e-bf1b-40b1-bf95-cb636be769eb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.470019 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33030e-bf1b-40b1-bf95-cb636be769eb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.470292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33030e-bf1b-40b1-bf95-cb636be769eb None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.471056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33030e-bf1b-40b1-bf95-cb636be769eb None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:44.471370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33030e-bf1b-40b1-bf95-cb636be769eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:44.472802 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33030e-bf1b-40b1-bf95-cb636be769eb None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:44.481333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 238/484] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:44.486972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261276d1-2a91-4312-a000-7c7c6fac6ce9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:44.593958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261276d1-2a91-4312-a000-7c7c6fac6ce9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:44.627122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1d00f-4546-485c-ac03-10011a45b260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:44.628920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1d00f-4546-485c-ac03-10011a45b260 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.629440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1d00f-4546-485c-ac03-10011a45b260 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.629927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1d00f-4546-485c-ac03-10011a45b260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.644073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1d00f-4546-485c-ac03-10011a45b260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:44.646066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1d00f-4546-485c-ac03-10011a45b260 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-c3e1d00f-4546-485c-ac03-10011a45b260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:44.665234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:44.666178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:44.667021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:44.667021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:44.667021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:44.667021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:44.669534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 247/485] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:44.678809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33030e-bf1b-40b1-bf95-cb636be769eb None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:44.845051 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33030e-bf1b-40b1-bf95-cb636be769eb None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:44.855523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a79c4-95d9-457a-957e-8bc624122c87 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.855843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a79c4-95d9-457a-957e-8bc624122c87 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.856098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a79c4-95d9-457a-957e-8bc624122c87 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.857756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 248/486] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:44.863056 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4f79f-2086-4cb1-8db1-b857dc311516 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.863411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4f79f-2086-4cb1-8db1-b857dc311516 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.863670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4f79f-2086-4cb1-8db1-b857dc311516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.881727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d0a4f79f-2086-4cb1-8db1-b857dc311516 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:44.882769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d0a4f79f-2086-4cb1-8db1-b857dc311516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:44.890885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69bdf-9c4b-4bdf-949a-a395877f3ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:44.891827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69bdf-9c4b-4bdf-949a-a395877f3ce2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.892651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69bdf-9c4b-4bdf-949a-a395877f3ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.893132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69bdf-9c4b-4bdf-949a-a395877f3ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.894782 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69bdf-9c4b-4bdf-949a-a395877f3ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:44.895288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69bdf-9c4b-4bdf-949a-a395877f3ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:44.897518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69bdf-9c4b-4bdf-949a-a395877f3ce2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:44.913365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 239/487] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:44.915116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e33c9-122b-4b8e-932e-4532560d38ec None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.915591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e33c9-122b-4b8e-932e-4532560d38ec None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.916050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e33c9-122b-4b8e-932e-4532560d38ec None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.918762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 240/488] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:44.923476 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e33c9-122b-4b8e-932e-4532560d38ec None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:44.952508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 249/489] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:44.962562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45118df-e72d-407a-baec-4969bfefd6ac None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:44.963263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45118df-e72d-407a-baec-4969bfefd6ac None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:44.963263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45118df-e72d-407a-baec-4969bfefd6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:44.990022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a45118df-e72d-407a-baec-4969bfefd6ac None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:44.991600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a45118df-e72d-407a-baec-4969bfefd6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:45.048292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e33c9-122b-4b8e-932e-4532560d38ec None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:45.057645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 250/490] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:45.066708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45118df-e72d-407a-baec-4969bfefd6ac None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.091353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe0873-f615-490d-93f0-6d1889029e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:45.092912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe0873-f615-490d-93f0-6d1889029e30 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.093191 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe0873-f615-490d-93f0-6d1889029e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.093486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe0873-f615-490d-93f0-6d1889029e30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.104946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe0873-f615-490d-93f0-6d1889029e30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:45.106364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe0873-f615-490d-93f0-6d1889029e30 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-24fe0873-f615-490d-93f0-6d1889029e30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:45.122107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:45.123069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:45.123966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 241/491] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 4 18:43:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:45.124842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe0873-f615-490d-93f0-6d1889029e30 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.191927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45118df-e72d-407a-baec-4969bfefd6ac None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:45.237913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e542328-f07b-403f-9534-e35e32726c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:45.239056 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e542328-f07b-403f-9534-e35e32726c92 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.239560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe0873-f615-490d-93f0-6d1889029e30 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:45.239668 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e542328-f07b-403f-9534-e35e32726c92 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.240115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e542328-f07b-403f-9534-e35e32726c92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.253468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e542328-f07b-403f-9534-e35e32726c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-2e542328-f07b-403f-9534-e35e32726c92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:45.263678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:45.264587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:45.265446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:45.269609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 251/492] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:45.271191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e542328-f07b-403f-9534-e35e32726c92 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.283878 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9239094-3766-4cfe-82c1-8998a8ac7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:45.284743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239094-3766-4cfe-82c1-8998a8ac7227 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.285123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239094-3766-4cfe-82c1-8998a8ac7227 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.285423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239094-3766-4cfe-82c1-8998a8ac7227 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.297871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9239094-3766-4cfe-82c1-8998a8ac7227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-b9239094-3766-4cfe-82c1-8998a8ac7227 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:45.308699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:45.309952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:45.310736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:45.313359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 242/493] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:45.314379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9239094-3766-4cfe-82c1-8998a8ac7227 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.386676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e542328-f07b-403f-9534-e35e32726c92 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:45.420266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff2d7a-d5b2-4db0-9f7a-fc989c9471eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:45.420962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff2d7a-d5b2-4db0-9f7a-fc989c9471eb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.421243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff2d7a-d5b2-4db0-9f7a-fc989c9471eb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.421555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff2d7a-d5b2-4db0-9f7a-fc989c9471eb None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.422403 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff2d7a-d5b2-4db0-9f7a-fc989c9471eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:45.422711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff2d7a-d5b2-4db0-9f7a-fc989c9471eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:45.424152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff2d7a-d5b2-4db0-9f7a-fc989c9471eb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:45.434124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9239094-3766-4cfe-82c1-8998a8ac7227 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:45.468236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 252/494] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:45.468236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff2d7a-d5b2-4db0-9f7a-fc989c9471eb None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.473750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f259ad9-1467-4212-99dc-3086eed68f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:45.474785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259ad9-1467-4212-99dc-3086eed68f0c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.475077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259ad9-1467-4212-99dc-3086eed68f0c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.475349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259ad9-1467-4212-99dc-3086eed68f0c None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.476422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f259ad9-1467-4212-99dc-3086eed68f0c None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:45.476998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f259ad9-1467-4212-99dc-3086eed68f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:45.478698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f259ad9-1467-4212-99dc-3086eed68f0c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:45.493515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 243/495] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:45.493515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535840e1-ee75-4b7d-a309-4461f05e6f6f None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.493515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535840e1-ee75-4b7d-a309-4461f05e6f6f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.493515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535840e1-ee75-4b7d-a309-4461f05e6f6f None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.494177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 244/496] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:45.494967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535840e1-ee75-4b7d-a309-4461f05e6f6f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.564765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff2d7a-d5b2-4db0-9f7a-fc989c9471eb None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:45.590804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535840e1-ee75-4b7d-a309-4461f05e6f6f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:45.599628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b51f82-6b3a-412f-a968-c03ca568821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:45.600301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b51f82-6b3a-412f-a968-c03ca568821a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.600646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b51f82-6b3a-412f-a968-c03ca568821a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.600919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b51f82-6b3a-412f-a968-c03ca568821a None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.601700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b51f82-6b3a-412f-a968-c03ca568821a None admin] RBAC: Adding query filter params (name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:45.602008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b51f82-6b3a-412f-a968-c03ca568821a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:45.603382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b51f82-6b3a-412f-a968-c03ca568821a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:45.615648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 253/497] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:45.615648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b51f82-6b3a-412f-a968-c03ca568821a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.627022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5db23-09cc-4bb4-8ef6-b384d0e4fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:45.627693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5db23-09cc-4bb4-8ef6-b384d0e4fa42 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.627959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5db23-09cc-4bb4-8ef6-b384d0e4fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.628214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5db23-09cc-4bb4-8ef6-b384d0e4fa42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.693067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5db23-09cc-4bb4-8ef6-b384d0e4fa42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:45.694474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5db23-09cc-4bb4-8ef6-b384d0e4fa42 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:45.709674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b51f82-6b3a-412f-a968-c03ca568821a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:45.741899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf08b6-62db-4dfb-bbc8-2d38803e5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:45.742693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf08b6-62db-4dfb-bbc8-2d38803e5292 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.742971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf08b6-62db-4dfb-bbc8-2d38803e5292 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.743241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf08b6-62db-4dfb-bbc8-2d38803e5292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.755053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf08b6-62db-4dfb-bbc8-2d38803e5292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:45.756494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf08b6-62db-4dfb-bbc8-2d38803e5292 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-ffbf08b6-62db-4dfb-bbc8-2d38803e5292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:45.772982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:45.774039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:45.774915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:45.774915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:45.774915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:45.774915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:45.774915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 254/498] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:45.775632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07b5a5-b802-4a19-9258-a26e8201d9cc None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.775632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07b5a5-b802-4a19-9258-a26e8201d9cc None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.775865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07b5a5-b802-4a19-9258-a26e8201d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.792849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-ee07b5a5-b802-4a19-9258-a26e8201d9cc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:45.793637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 245/499] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:45.794509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5db23-09cc-4bb4-8ef6-b384d0e4fa42 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.794823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ee07b5a5-b802-4a19-9258-a26e8201d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:45.869441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 255/500] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:45.870665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07b5a5-b802-4a19-9258-a26e8201d9cc None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.895214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5db23-09cc-4bb4-8ef6-b384d0e4fa42 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:45.927586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6e4e0-b353-472a-8a3c-928d1a1ac826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:45.928397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6e4e0-b353-472a-8a3c-928d1a1ac826 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:45.928656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6e4e0-b353-472a-8a3c-928d1a1ac826 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:45.928926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6e4e0-b353-472a-8a3c-928d1a1ac826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:45.938435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6e4e0-b353-472a-8a3c-928d1a1ac826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:45.939857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6e4e0-b353-472a-8a3c-928d1a1ac826 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-25e6e4e0-b353-472a-8a3c-928d1a1ac826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:45.957177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:45.958220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:45.959066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:45.959066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:45.959066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:45.959066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:45.959066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 246/501] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:45.959066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6e4e0-b353-472a-8a3c-928d1a1ac826 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:45.973504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07b5a5-b802-4a19-9258-a26e8201d9cc None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.008132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c7cd3-d927-43ea-98ea-73bcfa692133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.008789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c7cd3-d927-43ea-98ea-73bcfa692133 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.009064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c7cd3-d927-43ea-98ea-73bcfa692133 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.009386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c7cd3-d927-43ea-98ea-73bcfa692133 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.010097 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c7cd3-d927-43ea-98ea-73bcfa692133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:46.010405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c7cd3-d927-43ea-98ea-73bcfa692133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.011785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c7cd3-d927-43ea-98ea-73bcfa692133 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.022933 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 256/502] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:46.023731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c7cd3-d927-43ea-98ea-73bcfa692133 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.053076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6e4e0-b353-472a-8a3c-928d1a1ac826 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.085681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ed272-f738-4563-a75b-4345b4b026ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.086455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ed272-f738-4563-a75b-4345b4b026ba None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.086728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ed272-f738-4563-a75b-4345b4b026ba None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.086993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ed272-f738-4563-a75b-4345b4b026ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.096412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ed272-f738-4563-a75b-4345b4b026ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.097928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ed272-f738-4563-a75b-4345b4b026ba None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-d19ed272-f738-4563-a75b-4345b4b026ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:46.114535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:46.115399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:46.116239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:46.116239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:46.116239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:46.116239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:46.116468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c7cd3-d927-43ea-98ea-73bcfa692133 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.116882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 247/503] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:46.116882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ed272-f738-4563-a75b-4345b4b026ba None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.147540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4d9b3-8315-4a5e-9d9e-fde29bb5318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.148332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4d9b3-8315-4a5e-9d9e-fde29bb5318d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.148617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4d9b3-8315-4a5e-9d9e-fde29bb5318d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.148895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4d9b3-8315-4a5e-9d9e-fde29bb5318d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.158262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4d9b3-8315-4a5e-9d9e-fde29bb5318d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-75d4d9b3-8315-4a5e-9d9e-fde29bb5318d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:46.165984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:46.166983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:46.167918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 257/504] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:46.168712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0345ee2-2983-4d66-8c97-cb45f66f9687 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.168935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0345ee2-2983-4d66-8c97-cb45f66f9687 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.169190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0345ee2-2983-4d66-8c97-cb45f66f9687 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.170592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 258/505] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:46.171096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0345ee2-2983-4d66-8c97-cb45f66f9687 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.218611 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ed272-f738-4563-a75b-4345b4b026ba None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.253659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434c766-5fcd-432f-ac94-05b15d5376aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.254918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434c766-5fcd-432f-ac94-05b15d5376aa None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.255417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434c766-5fcd-432f-ac94-05b15d5376aa None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.255919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434c766-5fcd-432f-ac94-05b15d5376aa None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.256667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434c766-5fcd-432f-ac94-05b15d5376aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:46.256974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434c766-5fcd-432f-ac94-05b15d5376aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.258448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434c766-5fcd-432f-ac94-05b15d5376aa None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.270459 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0345ee2-2983-4d66-8c97-cb45f66f9687 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.271372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 248/506] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:46.272187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434c766-5fcd-432f-ac94-05b15d5376aa None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.304518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632fa9-d005-41c0-b47f-4011fc45e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.305326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632fa9-d005-41c0-b47f-4011fc45e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.305623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632fa9-d005-41c0-b47f-4011fc45e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.306117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632fa9-d005-41c0-b47f-4011fc45e8c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.313765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0632fa9-d005-41c0-b47f-4011fc45e8c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.315242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0632fa9-d005-41c0-b47f-4011fc45e8c9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a0632fa9-d005-41c0-b47f-4011fc45e8c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:46.330220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:46.331298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 259/507] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:46.332557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632fa9-d005-41c0-b47f-4011fc45e8c9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.381691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434c766-5fcd-432f-ac94-05b15d5376aa None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.415251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4dca9-9242-4056-b82e-ee7ff9616f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.415906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4dca9-9242-4056-b82e-ee7ff9616f38 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.416219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4dca9-9242-4056-b82e-ee7ff9616f38 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.416487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4dca9-9242-4056-b82e-ee7ff9616f38 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.417188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4dca9-9242-4056-b82e-ee7ff9616f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:46.417521 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4dca9-9242-4056-b82e-ee7ff9616f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.418911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4dca9-9242-4056-b82e-ee7ff9616f38 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.428022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632fa9-d005-41c0-b47f-4011fc45e8c9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.430511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 249/508] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:46.431753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dad7b2-b7c2-4f38-813d-ef5bd24833c6 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.432033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dad7b2-b7c2-4f38-813d-ef5bd24833c6 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.432384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dad7b2-b7c2-4f38-813d-ef5bd24833c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.448537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-e6dad7b2-b7c2-4f38-813d-ef5bd24833c6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:46.449738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e6dad7b2-b7c2-4f38-813d-ef5bd24833c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:46.462453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3417-86b7-4cb1-8b0b-1df4e28ccb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.463096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3417-86b7-4cb1-8b0b-1df4e28ccb55 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.463376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3417-86b7-4cb1-8b0b-1df4e28ccb55 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.463645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3417-86b7-4cb1-8b0b-1df4e28ccb55 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.464410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3417-86b7-4cb1-8b0b-1df4e28ccb55 None admin] RBAC: Adding query filter params (name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:46.464699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3417-86b7-4cb1-8b0b-1df4e28ccb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.466102 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3417-86b7-4cb1-8b0b-1df4e28ccb55 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.473992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 260/509] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:46.474747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3417-86b7-4cb1-8b0b-1df4e28ccb55 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.516076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 250/510] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:46.516904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dad7b2-b7c2-4f38-813d-ef5bd24833c6 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.566966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3417-86b7-4cb1-8b0b-1df4e28ccb55 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.599228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d91d3-5937-41bd-9a41-c1f20277b470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.600033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d91d3-5937-41bd-9a41-c1f20277b470 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.600310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d91d3-5937-41bd-9a41-c1f20277b470 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.600584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d91d3-5937-41bd-9a41-c1f20277b470 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.608468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d91d3-5937-41bd-9a41-c1f20277b470 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.609948 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d91d3-5937-41bd-9a41-c1f20277b470 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.610154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dad7b2-b7c2-4f38-813d-ef5bd24833c6 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-0f9d91d3-5937-41bd-9a41-c1f20277b470 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:46.624929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:46.626020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 261/511] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:46.627936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d91d3-5937-41bd-9a41-c1f20277b470 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.645565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e6326-4b71-400c-b427-93c75b67069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.646240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6326-4b71-400c-b427-93c75b67069e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.646490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6326-4b71-400c-b427-93c75b67069e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.646797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6326-4b71-400c-b427-93c75b67069e None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.647610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e6326-4b71-400c-b427-93c75b67069e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:46.647920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e6326-4b71-400c-b427-93c75b67069e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.649360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e6326-4b71-400c-b427-93c75b67069e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.683981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 251/512] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:46.684774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e6326-4b71-400c-b427-93c75b67069e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.730758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d91d3-5937-41bd-9a41-c1f20277b470 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.762826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7f400-4d93-49be-a239-3a7b6cd81906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.763710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f400-4d93-49be-a239-3a7b6cd81906 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.764058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f400-4d93-49be-a239-3a7b6cd81906 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.764327 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f400-4d93-49be-a239-3a7b6cd81906 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.771008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7f400-4d93-49be-a239-3a7b6cd81906 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.772463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7f400-4d93-49be-a239-3a7b6cd81906 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.777839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e6326-4b71-400c-b427-93c75b67069e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-ddf7f400-4d93-49be-a239-3a7b6cd81906 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:46.786921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:46.787921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 262/513] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:46.788950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7f400-4d93-49be-a239-3a7b6cd81906 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.815153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f212e-dc75-4bfa-ac31-93b5b669d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.816084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f212e-dc75-4bfa-ac31-93b5b669d203 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.816474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f212e-dc75-4bfa-ac31-93b5b669d203 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.816751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f212e-dc75-4bfa-ac31-93b5b669d203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.826376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f212e-dc75-4bfa-ac31-93b5b669d203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.827891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f212e-dc75-4bfa-ac31-93b5b669d203 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-1c1f212e-dc75-4bfa-ac31-93b5b669d203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:46.845317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:46.846332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:46.847357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:46.847357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:46.847357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:46.847357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:46.849629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 252/514] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:46.850384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f212e-dc75-4bfa-ac31-93b5b669d203 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.882558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7f400-4d93-49be-a239-3a7b6cd81906 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.916782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be14ba-6f7f-4e8a-b3cb-3b724ddec6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.917685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be14ba-6f7f-4e8a-b3cb-3b724ddec6f9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.918138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be14ba-6f7f-4e8a-b3cb-3b724ddec6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.918418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be14ba-6f7f-4e8a-b3cb-3b724ddec6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.930444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be14ba-6f7f-4e8a-b3cb-3b724ddec6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.931900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be14ba-6f7f-4e8a-b3cb-3b724ddec6f9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:46.946881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f212e-dc75-4bfa-ac31-93b5b669d203 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-75be14ba-6f7f-4e8a-b3cb-3b724ddec6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:46.948633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:46.949692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:46.956152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:46.956152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:46.956152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:46.956152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:46.956152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 263/515] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:46.956152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be14ba-6f7f-4e8a-b3cb-3b724ddec6f9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:46.981423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca068d0-ccde-4973-9808-0c461dcd24fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:46.982044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca068d0-ccde-4973-9808-0c461dcd24fe None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:46.982321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca068d0-ccde-4973-9808-0c461dcd24fe None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:46.982586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca068d0-ccde-4973-9808-0c461dcd24fe None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:46.983427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca068d0-ccde-4973-9808-0c461dcd24fe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:46.983737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca068d0-ccde-4973-9808-0c461dcd24fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:46.985163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca068d0-ccde-4973-9808-0c461dcd24fe None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.002375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 253/516] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:47.003177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca068d0-ccde-4973-9808-0c461dcd24fe None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.046926 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be14ba-6f7f-4e8a-b3cb-3b724ddec6f9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.080317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73edf4-e18c-40ea-afda-7c08e28d2b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.081020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73edf4-e18c-40ea-afda-7c08e28d2b06 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.081323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73edf4-e18c-40ea-afda-7c08e28d2b06 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.081598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73edf4-e18c-40ea-afda-7c08e28d2b06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.096893 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca068d0-ccde-4973-9808-0c461dcd24fe None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.130528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01890-b778-4f77-947a-4b3c389c038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.131178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01890-b778-4f77-947a-4b3c389c038a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.131453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01890-b778-4f77-947a-4b3c389c038a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.131723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01890-b778-4f77-947a-4b3c389c038a None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.132501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01890-b778-4f77-947a-4b3c389c038a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:47.132807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01890-b778-4f77-947a-4b3c389c038a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.134288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01890-b778-4f77-947a-4b3c389c038a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.144074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73edf4-e18c-40ea-afda-7c08e28d2b06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.145634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73edf4-e18c-40ea-afda-7c08e28d2b06 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.151164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 254/517] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:47.151942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01890-b778-4f77-947a-4b3c389c038a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.236641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 264/518] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:47.237395 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73edf4-e18c-40ea-afda-7c08e28d2b06 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.251118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01890-b778-4f77-947a-4b3c389c038a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.284385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef76572-d1ad-438e-8031-48370d1a6756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.285066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef76572-d1ad-438e-8031-48370d1a6756 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.285369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef76572-d1ad-438e-8031-48370d1a6756 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.285644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef76572-d1ad-438e-8031-48370d1a6756 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.286382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef76572-d1ad-438e-8031-48370d1a6756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:47.286672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef76572-d1ad-438e-8031-48370d1a6756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.288037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef76572-d1ad-438e-8031-48370d1a6756 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.298894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 255/519] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:47.299627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef76572-d1ad-438e-8031-48370d1a6756 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.330458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73edf4-e18c-40ea-afda-7c08e28d2b06 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.363046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aafa29-d2df-42a4-a6ab-b98d07a0a478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.363742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aafa29-d2df-42a4-a6ab-b98d07a0a478 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.364023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aafa29-d2df-42a4-a6ab-b98d07a0a478 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.364295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aafa29-d2df-42a4-a6ab-b98d07a0a478 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.365015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aafa29-d2df-42a4-a6ab-b98d07a0a478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:47.365350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aafa29-d2df-42a4-a6ab-b98d07a0a478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.366716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aafa29-d2df-42a4-a6ab-b98d07a0a478 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.377880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 265/520] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:47.378652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aafa29-d2df-42a4-a6ab-b98d07a0a478 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.393946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef76572-d1ad-438e-8031-48370d1a6756 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.424723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc37d1-2010-49be-bedc-bf0759a281c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.425361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc37d1-2010-49be-bedc-bf0759a281c9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.425704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc37d1-2010-49be-bedc-bf0759a281c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.425975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc37d1-2010-49be-bedc-bf0759a281c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.472877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aafa29-d2df-42a4-a6ab-b98d07a0a478 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.493712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc37d1-2010-49be-bedc-bf0759a281c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.495122 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc37d1-2010-49be-bedc-bf0759a281c9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.504749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5574cc-34d7-4077-8ee6-09d875d12725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.505431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5574cc-34d7-4077-8ee6-09d875d12725 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.505716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5574cc-34d7-4077-8ee6-09d875d12725 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.506009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5574cc-34d7-4077-8ee6-09d875d12725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.506850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5574cc-34d7-4077-8ee6-09d875d12725 None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=3938216005694c45bd6126415930d014) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:47.507198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5574cc-34d7-4077-8ee6-09d875d12725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.508718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5574cc-34d7-4077-8ee6-09d875d12725 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.514199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 266/521] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/role_assignments?user.id=3938216005694c45bd6126415930d014&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:47.514967 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5574cc-34d7-4077-8ee6-09d875d12725 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.595449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 256/522] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:47.596323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc37d1-2010-49be-bedc-bf0759a281c9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.622034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5574cc-34d7-4077-8ee6-09d875d12725 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.657560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860318d8-a95c-4eae-8871-fed4b4e097f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.659254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860318d8-a95c-4eae-8871-fed4b4e097f3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.660100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860318d8-a95c-4eae-8871-fed4b4e097f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.660593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860318d8-a95c-4eae-8871-fed4b4e097f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.672705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860318d8-a95c-4eae-8871-fed4b4e097f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.674122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860318d8-a95c-4eae-8871-fed4b4e097f3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-860318d8-a95c-4eae-8871-fed4b4e097f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:47.691498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:47.692428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:47.693274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:47.693274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:47.693274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:47.693274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:47.693274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 267/523] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:47.693579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860318d8-a95c-4eae-8871-fed4b4e097f3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.702907 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc37d1-2010-49be-bedc-bf0759a281c9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.741987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280d6d5-5609-4c20-8989-4cf61a76f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.742792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280d6d5-5609-4c20-8989-4cf61a76f177 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.743065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280d6d5-5609-4c20-8989-4cf61a76f177 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.743330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280d6d5-5609-4c20-8989-4cf61a76f177 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.751126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280d6d5-5609-4c20-8989-4cf61a76f177 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.752511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280d6d5-5609-4c20-8989-4cf61a76f177 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-4280d6d5-5609-4c20-8989-4cf61a76f177 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:47.767104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:47.768021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:43:47.768919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:47.770788 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 257/524] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:47.771694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280d6d5-5609-4c20-8989-4cf61a76f177 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.799432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860318d8-a95c-4eae-8871-fed4b4e097f3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.831360 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077404-df7b-46e2-9b02-e24631a4c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.832058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077404-df7b-46e2-9b02-e24631a4c4a9 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.832332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077404-df7b-46e2-9b02-e24631a4c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.832596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077404-df7b-46e2-9b02-e24631a4c4a9 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.833317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47077404-df7b-46e2-9b02-e24631a4c4a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.834735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47077404-df7b-46e2-9b02-e24631a4c4a9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.861329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 268/525] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:43:47 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:43:47.861329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077404-df7b-46e2-9b02-e24631a4c4a9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.875477 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280d6d5-5609-4c20-8989-4cf61a76f177 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:47.915938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5ab9e-0b51-4f1f-b33c-a10df4d4a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:47.916929 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ab9e-0b51-4f1f-b33c-a10df4d4a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:47.917270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ab9e-0b51-4f1f-b33c-a10df4d4a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:47.917633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ab9e-0b51-4f1f-b33c-a10df4d4a0a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:47.929656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5ab9e-0b51-4f1f-b33c-a10df4d4a0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:47.931178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5ab9e-0b51-4f1f-b33c-a10df4d4a0a3 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-25c5ab9e-0b51-4f1f-b33c-a10df4d4a0a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:47.949713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:47.950654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:47.951512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:47.951512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:47.951512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:47.951512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:47.951512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 258/526] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:47.952265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5ab9e-0b51-4f1f-b33c-a10df4d4a0a3 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:47.984517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077404-df7b-46e2-9b02-e24631a4c4a9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.019092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60bf10-9b95-43ee-84e7-c31c4354920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.019738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60bf10-9b95-43ee-84e7-c31c4354920b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.020014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60bf10-9b95-43ee-84e7-c31c4354920b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.020282 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60bf10-9b95-43ee-84e7-c31c4354920b None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.021125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60bf10-9b95-43ee-84e7-c31c4354920b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:48.021461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60bf10-9b95-43ee-84e7-c31c4354920b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.022887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60bf10-9b95-43ee-84e7-c31c4354920b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.036051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 269/527] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:48.036922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60bf10-9b95-43ee-84e7-c31c4354920b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.071924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5ab9e-0b51-4f1f-b33c-a10df4d4a0a3 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.106968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cfe53-c052-4ead-85ef-d55cee94027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.107688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cfe53-c052-4ead-85ef-d55cee94027c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.107919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cfe53-c052-4ead-85ef-d55cee94027c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.108193 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cfe53-c052-4ead-85ef-d55cee94027c None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.109062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cfe53-c052-4ead-85ef-d55cee94027c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:48.109394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cfe53-c052-4ead-85ef-d55cee94027c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.110954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cfe53-c052-4ead-85ef-d55cee94027c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.134845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 259/528] 10.222.0.35 () {56 vars in 1139 bytes} [Wed May 4 18:43:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:48.135337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60bf10-9b95-43ee-84e7-c31c4354920b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.135730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cfe53-c052-4ead-85ef-d55cee94027c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.175721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3f97f-8f2f-4bb5-8335-ad55804a2a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.177641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3f97f-8f2f-4bb5-8335-ad55804a2a93 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.178131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3f97f-8f2f-4bb5-8335-ad55804a2a93 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.178912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3f97f-8f2f-4bb5-8335-ad55804a2a93 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.180123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3f97f-8f2f-4bb5-8335-ad55804a2a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:48.180611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3f97f-8f2f-4bb5-8335-ad55804a2a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.183088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3f97f-8f2f-4bb5-8335-ad55804a2a93 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.198608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 270/529] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:48.199752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3f97f-8f2f-4bb5-8335-ad55804a2a93 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.234128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cfe53-c052-4ead-85ef-d55cee94027c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.267653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb967918-11e2-41b2-994b-ff49f6842afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.268448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967918-11e2-41b2-994b-ff49f6842afb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.268721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967918-11e2-41b2-994b-ff49f6842afb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.268981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb967918-11e2-41b2-994b-ff49f6842afb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.277392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb967918-11e2-41b2-994b-ff49f6842afb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.279378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb967918-11e2-41b2-994b-ff49f6842afb None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-bb967918-11e2-41b2-994b-ff49f6842afb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:48.298270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:48.299180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:48.300044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:48.300044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:48.300044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:48.300044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:48.300044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:48.300044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:48.300044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:48.300044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:48.300460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3f97f-8f2f-4bb5-8335-ad55804a2a93 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.300574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 260/530] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:48.302006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb967918-11e2-41b2-994b-ff49f6842afb None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.332811 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f129-01e1-4cf4-bb28-fd9892429b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.333488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f129-01e1-4cf4-bb28-fd9892429b4c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.333767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f129-01e1-4cf4-bb28-fd9892429b4c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.334038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f129-01e1-4cf4-bb28-fd9892429b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.401672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497f129-01e1-4cf4-bb28-fd9892429b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.403127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497f129-01e1-4cf4-bb28-fd9892429b4c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.404763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb967918-11e2-41b2-994b-ff49f6842afb None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.437057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603f56c-0f4d-428b-9494-596f33442602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.437928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603f56c-0f4d-428b-9494-596f33442602 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.438210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603f56c-0f4d-428b-9494-596f33442602 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.438483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603f56c-0f4d-428b-9494-596f33442602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.445136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603f56c-0f4d-428b-9494-596f33442602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.446660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603f56c-0f4d-428b-9494-596f33442602 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-1603f56c-0f4d-428b-9494-596f33442602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:48.460998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:48.461919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:48.462809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:48.462809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:48.462809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:48.462809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:48.462809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:48.462809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:48.462809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:48.462809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:48.462809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 261/531] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:48.463293 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603f56c-0f4d-428b-9494-596f33442602 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.514477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 271/532] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:48.515518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f129-01e1-4cf4-bb28-fd9892429b4c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.559315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603f56c-0f4d-428b-9494-596f33442602 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.594914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ebd41-b3a9-4677-969c-9a7c37c6ca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.595583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ebd41-b3a9-4677-969c-9a7c37c6ca33 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.596003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ebd41-b3a9-4677-969c-9a7c37c6ca33 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.596278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ebd41-b3a9-4677-969c-9a7c37c6ca33 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.597384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ebd41-b3a9-4677-969c-9a7c37c6ca33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:48.597752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ebd41-b3a9-4677-969c-9a7c37c6ca33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.599181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ebd41-b3a9-4677-969c-9a7c37c6ca33 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.613545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 262/533] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:48.614656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ebd41-b3a9-4677-969c-9a7c37c6ca33 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.615329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f129-01e1-4cf4-bb28-fd9892429b4c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.661814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f47d5c-84fe-4eb6-b89d-528d89a950fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.662792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f47d5c-84fe-4eb6-b89d-528d89a950fe None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.663313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f47d5c-84fe-4eb6-b89d-528d89a950fe None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.663598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f47d5c-84fe-4eb6-b89d-528d89a950fe None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.664451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f47d5c-84fe-4eb6-b89d-528d89a950fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:48.664913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f47d5c-84fe-4eb6-b89d-528d89a950fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.666976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f47d5c-84fe-4eb6-b89d-528d89a950fe None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.689966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 272/534] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:48.690812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f47d5c-84fe-4eb6-b89d-528d89a950fe None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.723013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ebd41-b3a9-4677-969c-9a7c37c6ca33 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.758276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4c59f-54ce-46e1-a1f7-b9ff869cd15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.759173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4c59f-54ce-46e1-a1f7-b9ff869cd15b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.759511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4c59f-54ce-46e1-a1f7-b9ff869cd15b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.759844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4c59f-54ce-46e1-a1f7-b9ff869cd15b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.770217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4c59f-54ce-46e1-a1f7-b9ff869cd15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.771729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4c59f-54ce-46e1-a1f7-b9ff869cd15b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-f8a4c59f-54ce-46e1-a1f7-b9ff869cd15b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:48.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:48.790499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:48.792089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:48.792089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:48.792089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:48.792089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:48.796679 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 263/535] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:48.796679 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4c59f-54ce-46e1-a1f7-b9ff869cd15b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.800666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f47d5c-84fe-4eb6-b89d-528d89a950fe None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.836907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be52a1-97cd-430c-b88d-c161759ab2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.837631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be52a1-97cd-430c-b88d-c161759ab2ff None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.837970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be52a1-97cd-430c-b88d-c161759ab2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.838308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be52a1-97cd-430c-b88d-c161759ab2ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.839205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be52a1-97cd-430c-b88d-c161759ab2ff None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=63b338ae7e374ba5a7542c5a53deb416) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:48.839576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be52a1-97cd-430c-b88d-c161759ab2ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.841069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be52a1-97cd-430c-b88d-c161759ab2ff None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.853875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 273/536] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/role_assignments?user.id=63b338ae7e374ba5a7542c5a53deb416&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:48.853875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be52a1-97cd-430c-b88d-c161759ab2ff None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:48.950133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4c59f-54ce-46e1-a1f7-b9ff869cd15b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.985398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddad8c-ed18-4e2f-92e0-c5a3d88dc3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:48.986477 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddad8c-ed18-4e2f-92e0-c5a3d88dc3d4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:48.986957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddad8c-ed18-4e2f-92e0-c5a3d88dc3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:48.987426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddad8c-ed18-4e2f-92e0-c5a3d88dc3d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:48.988509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddad8c-ed18-4e2f-92e0-c5a3d88dc3d4 None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=432759ff503942e7ae6941f9d4b951b4) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:48.989041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddad8c-ed18-4e2f-92e0-c5a3d88dc3d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:48.989792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be52a1-97cd-430c-b88d-c161759ab2ff None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:48.990966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddad8c-ed18-4e2f-92e0-c5a3d88dc3d4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:48.997665 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 264/537] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/role_assignments?user.id=432759ff503942e7ae6941f9d4b951b4&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:49.037149 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294536-0b1d-4807-924a-a42254676a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:49.037865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294536-0b1d-4807-924a-a42254676a9a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:49.038144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294536-0b1d-4807-924a-a42254676a9a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:49.038417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294536-0b1d-4807-924a-a42254676a9a None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:49.039169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a294536-0b1d-4807-924a-a42254676a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:49.039475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a294536-0b1d-4807-924a-a42254676a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:49.040923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a294536-0b1d-4807-924a-a42254676a9a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:49.064559 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 274/538] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:49.070519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddad8c-ed18-4e2f-92e0-c5a3d88dc3d4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:49.197441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddad8c-ed18-4e2f-92e0-c5a3d88dc3d4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:49.231557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261a765-4d2c-45a2-b69b-238794659ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:49.232360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261a765-4d2c-45a2-b69b-238794659ee4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:49.232640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261a765-4d2c-45a2-b69b-238794659ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:49.232910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261a765-4d2c-45a2-b69b-238794659ee4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:49.239795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261a765-4d2c-45a2-b69b-238794659ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:49.241253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261a765-4d2c-45a2-b69b-238794659ee4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-a261a765-4d2c-45a2-b69b-238794659ee4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:49.255696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:49.256577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:49.257474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:49.257474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:49.257474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:49.257474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:49.257474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:49.257474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:49.257474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:49.257474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:49.257474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 265/539] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:49.262801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294536-0b1d-4807-924a-a42254676a9a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:49.413123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294536-0b1d-4807-924a-a42254676a9a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:49.447611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c84f4d-685d-438c-a7e2-0b4ae972204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:49.448603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c84f4d-685d-438c-a7e2-0b4ae972204b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:49.449088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c84f4d-685d-438c-a7e2-0b4ae972204b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:49.449597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c84f4d-685d-438c-a7e2-0b4ae972204b None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:49.450645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c84f4d-685d-438c-a7e2-0b4ae972204b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:49.451192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c84f4d-685d-438c-a7e2-0b4ae972204b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:49.453522 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c84f4d-685d-438c-a7e2-0b4ae972204b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:49.466421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 275/540] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:49.472486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261a765-4d2c-45a2-b69b-238794659ee4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:49.625494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261a765-4d2c-45a2-b69b-238794659ee4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:49.668465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128f29c-eb8a-4010-ab25-5b295af8d84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:49.669147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128f29c-eb8a-4010-ab25-5b295af8d84c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:49.669500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128f29c-eb8a-4010-ab25-5b295af8d84c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:49.669778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128f29c-eb8a-4010-ab25-5b295af8d84c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:49.670675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128f29c-eb8a-4010-ab25-5b295af8d84c None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=94b338c27d664f51bc9de29c9c6ba40e) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:49.670995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128f29c-eb8a-4010-ab25-5b295af8d84c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:49.672486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128f29c-eb8a-4010-ab25-5b295af8d84c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:49.679286 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 266/541] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:49 2022] GET /identity/v3/role_assignments?user.id=94b338c27d664f51bc9de29c9c6ba40e&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:49.872792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f6cd-92e6-4ad9-8e4f-bcb6b60d148f None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:49.873185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f6cd-92e6-4ad9-8e4f-bcb6b60d148f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:49.873411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f6cd-92e6-4ad9-8e4f-bcb6b60d148f None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:49.875431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 276/542] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:49.881718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55daf-df7d-42a1-8710-97517bbbd1d0 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:49.882027 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55daf-df7d-42a1-8710-97517bbbd1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:49.882281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55daf-df7d-42a1-8710-97517bbbd1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:49.903860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-f3d55daf-df7d-42a1-8710-97517bbbd1d0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:49.905073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f3d55daf-df7d-42a1-8710-97517bbbd1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:49.993549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 267/543] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:50.028079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f6cd-92e6-4ad9-8e4f-bcb6b60d148f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:50.160613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f6cd-92e6-4ad9-8e4f-bcb6b60d148f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:50.202390 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963a1e9-5e6d-4375-be05-485a297feff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:50.203202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963a1e9-5e6d-4375-be05-485a297feff6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:50.203482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963a1e9-5e6d-4375-be05-485a297feff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:50.203753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963a1e9-5e6d-4375-be05-485a297feff6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:50.217125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963a1e9-5e6d-4375-be05-485a297feff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a963a1e9-5e6d-4375-be05-485a297feff6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:50.224875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:50.226009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:50.227040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:50.230538 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 277/544] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:50.236590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55daf-df7d-42a1-8710-97517bbbd1d0 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:50.395242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55daf-df7d-42a1-8710-97517bbbd1d0 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:50.444210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ce031-755b-4ed4-9039-769af844fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:50.444815 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ce031-755b-4ed4-9039-769af844fc99 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:50.445097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ce031-755b-4ed4-9039-769af844fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:50.445396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ce031-755b-4ed4-9039-769af844fc99 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:50.446174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ce031-755b-4ed4-9039-769af844fc99 None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:50.446482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ce031-755b-4ed4-9039-769af844fc99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:50.447889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ce031-755b-4ed4-9039-769af844fc99 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:50.463853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 268/545] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:50.469524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963a1e9-5e6d-4375-be05-485a297feff6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:50.651776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963a1e9-5e6d-4375-be05-485a297feff6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:50.693087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cadb8c-c699-46ce-86eb-da7b46b8a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:50.694086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cadb8c-c699-46ce-86eb-da7b46b8a1df None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:50.697376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cadb8c-c699-46ce-86eb-da7b46b8a1df None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:50.697376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cadb8c-c699-46ce-86eb-da7b46b8a1df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:50.711910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cadb8c-c699-46ce-86eb-da7b46b8a1df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:50.713442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cadb8c-c699-46ce-86eb-da7b46b8a1df None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:50.727147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5b49-40e7-43e5-aac4-7eeadcdd9fe5 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:50.727425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5b49-40e7-43e5-aac4-7eeadcdd9fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:50.727706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5b49-40e7-43e5-aac4-7eeadcdd9fe5 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:50.729279 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 269/546] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:50.734997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e34114-ca98-4e0f-bd45-1e92e09bcca4 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:50.735284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e34114-ca98-4e0f-bd45-1e92e09bcca4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:50.735563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e34114-ca98-4e0f-bd45-1e92e09bcca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-08cadb8c-c699-46ce-86eb-da7b46b8a1df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:50.738750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:50.739639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:50.740568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:50.740568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:50.740568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:50.740568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:50.740568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 278/547] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:50.747709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cadb8c-c699-46ce-86eb-da7b46b8a1df None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:50.797217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-73e34114-ca98-4e0f-bd45-1e92e09bcca4 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:50.798428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-73e34114-ca98-4e0f-bd45-1e92e09bcca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:50.850668 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cadb8c-c699-46ce-86eb-da7b46b8a1df None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:50.904256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6583-5c7d-48c1-8052-376b317d9d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:50.905312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6583-5c7d-48c1-8052-376b317d9d63 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:50.905799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6583-5c7d-48c1-8052-376b317d9d63 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:50.906314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6583-5c7d-48c1-8052-376b317d9d63 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:50.907314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6583-5c7d-48c1-8052-376b317d9d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:50.909178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6583-5c7d-48c1-8052-376b317d9d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:50.910845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6583-5c7d-48c1-8052-376b317d9d63 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:50.939413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 270/549] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:43:50.939600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 279/549] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:50.945562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6583-5c7d-48c1-8052-376b317d9d63 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:50.964287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e34114-ca98-4e0f-bd45-1e92e09bcca4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:51.103214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6583-5c7d-48c1-8052-376b317d9d63 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:51.140810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba9f1-ffba-4809-bb2b-893a8ae35eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:51.141824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba9f1-ffba-4809-bb2b-893a8ae35eeb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.142099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba9f1-ffba-4809-bb2b-893a8ae35eeb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.142375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ba9f1-ffba-4809-bb2b-893a8ae35eeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.150348 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ba9f1-ffba-4809-bb2b-893a8ae35eeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:51.151494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e34114-ca98-4e0f-bd45-1e92e09bcca4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:51.151849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ba9f1-ffba-4809-bb2b-893a8ae35eeb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-126ba9f1-ffba-4809-bb2b-893a8ae35eeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:51.167930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:51.168971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:51.169972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 280/550] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 4 18:43:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:51.177444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba9f1-ffba-4809-bb2b-893a8ae35eeb None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:51.234268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b38e49-9ec0-44fa-9e2e-24e8537858a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:51.235040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b38e49-9ec0-44fa-9e2e-24e8537858a4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.235331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b38e49-9ec0-44fa-9e2e-24e8537858a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.235593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b38e49-9ec0-44fa-9e2e-24e8537858a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.266190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b38e49-9ec0-44fa-9e2e-24e8537858a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-42b38e49-9ec0-44fa-9e2e-24e8537858a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:51.274190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:51.276266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:51.278245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:51.285308 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 271/551] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:51.285546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ba9f1-ffba-4809-bb2b-893a8ae35eeb None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:51.289457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b38e49-9ec0-44fa-9e2e-24e8537858a4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:51.324364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf0791-d8c8-4c52-9fc3-356de87505a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:51.325065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf0791-d8c8-4c52-9fc3-356de87505a6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.325453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf0791-d8c8-4c52-9fc3-356de87505a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.325748 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf0791-d8c8-4c52-9fc3-356de87505a6 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.327007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf0791-d8c8-4c52-9fc3-356de87505a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:51.327466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf0791-d8c8-4c52-9fc3-356de87505a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:51.328920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf0791-d8c8-4c52-9fc3-356de87505a6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:51.348396 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 281/552] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 4 18:43:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:51.353912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf0791-d8c8-4c52-9fc3-356de87505a6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:51.459968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf0791-d8c8-4c52-9fc3-356de87505a6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:51.493512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9eaed-25fe-4fb9-b918-6ffda15e643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:51.494479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9eaed-25fe-4fb9-b918-6ffda15e643a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.494479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9eaed-25fe-4fb9-b918-6ffda15e643a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.494954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9eaed-25fe-4fb9-b918-6ffda15e643a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.506637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9eaed-25fe-4fb9-b918-6ffda15e643a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:51.508278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9eaed-25fe-4fb9-b918-6ffda15e643a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:51.524834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b38e49-9ec0-44fa-9e2e-24e8537858a4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-9cb9eaed-25fe-4fb9-b918-6ffda15e643a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:51.527070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:51.527932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:51.528790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:51.528790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:51.528790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:51.528790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:51.528790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 282/553] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:51.539042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9eaed-25fe-4fb9-b918-6ffda15e643a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:51.619361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f43c84-d47d-453d-8828-ec1c4d3f1217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:51.620046 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f43c84-d47d-453d-8828-ec1c4d3f1217 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.620332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f43c84-d47d-453d-8828-ec1c4d3f1217 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.620605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f43c84-d47d-453d-8828-ec1c4d3f1217 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.621394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f43c84-d47d-453d-8828-ec1c4d3f1217 None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:51.621708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f43c84-d47d-453d-8828-ec1c4d3f1217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:51.623092 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f43c84-d47d-453d-8828-ec1c4d3f1217 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:51.643567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 272/554] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:51.654337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f43c84-d47d-453d-8828-ec1c4d3f1217 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:51.660546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9eaed-25fe-4fb9-b918-6ffda15e643a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:51.694450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827efaba-d115-46d5-8df6-070a9945dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:51.695120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efaba-d115-46d5-8df6-070a9945dac4 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.695400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efaba-d115-46d5-8df6-070a9945dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.695690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efaba-d115-46d5-8df6-070a9945dac4 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.696401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827efaba-d115-46d5-8df6-070a9945dac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:51.696705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827efaba-d115-46d5-8df6-070a9945dac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:51.698100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827efaba-d115-46d5-8df6-070a9945dac4 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:51.709679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 283/555] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:51.710790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8556d1-7402-4381-bb93-ee1f28187f13 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.711076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8556d1-7402-4381-bb93-ee1f28187f13 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.711382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8556d1-7402-4381-bb93-ee1f28187f13 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.717462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 284/556] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:51.718228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8556d1-7402-4381-bb93-ee1f28187f13 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:51.802823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f43c84-d47d-453d-8828-ec1c4d3f1217 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:51.822503 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8556d1-7402-4381-bb93-ee1f28187f13 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:51.835224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870b7ab-b913-4447-b5c4-02ca8d1e0204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:51.836029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870b7ab-b913-4447-b5c4-02ca8d1e0204 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.836308 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870b7ab-b913-4447-b5c4-02ca8d1e0204 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.836580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870b7ab-b913-4447-b5c4-02ca8d1e0204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.846719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870b7ab-b913-4447-b5c4-02ca8d1e0204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:51.848212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870b7ab-b913-4447-b5c4-02ca8d1e0204 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:51.860441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013572e8-108f-40b5-ba60-031ae39b855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:51.861547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013572e8-108f-40b5-ba60-031ae39b855e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.862018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013572e8-108f-40b5-ba60-031ae39b855e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.862493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013572e8-108f-40b5-ba60-031ae39b855e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-f870b7ab-b913-4447-b5c4-02ca8d1e0204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:51.864668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:51.865516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:51.866992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:51.866992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:51.866992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:51.866992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:51.866992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 273/557] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:51.867378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3aea0-bb1d-4cac-aec5-f938af34315e None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.867615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3aea0-bb1d-4cac-aec5-f938af34315e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.867884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3aea0-bb1d-4cac-aec5-f938af34315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.873553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013572e8-108f-40b5-ba60-031ae39b855e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:51.875321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013572e8-108f-40b5-ba60-031ae39b855e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:51.885073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-6bb3aea0-bb1d-4cac-aec5-f938af34315e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:51.886325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6bb3aea0-bb1d-4cac-aec5-f938af34315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-013572e8-108f-40b5-ba60-031ae39b855e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:51.891340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:51.892164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:51.893019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:51.893019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:51.893019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:51.893019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:51.893019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:51.893019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:51.893019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:51.893019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:51.897522 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 285/558] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:51.898750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93be09d-c67f-480c-ae57-01c357583f68 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:51.899162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93be09d-c67f-480c-ae57-01c357583f68 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:51.899283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93be09d-c67f-480c-ae57-01c357583f68 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:51.900760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 286/559] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:51.905494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93be09d-c67f-480c-ae57-01c357583f68 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:51.957329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 274/560] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:51.957329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3aea0-bb1d-4cac-aec5-f938af34315e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.016921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93be09d-c67f-480c-ae57-01c357583f68 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.049637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653158da-4163-4ddc-bc81-c2495fb9aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.050312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653158da-4163-4ddc-bc81-c2495fb9aeef None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.050577 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653158da-4163-4ddc-bc81-c2495fb9aeef None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.050848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653158da-4163-4ddc-bc81-c2495fb9aeef None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.051566 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653158da-4163-4ddc-bc81-c2495fb9aeef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:52.051869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653158da-4163-4ddc-bc81-c2495fb9aeef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:52.053315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653158da-4163-4ddc-bc81-c2495fb9aeef None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:52.058784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3aea0-bb1d-4cac-aec5-f938af34315e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.069039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 287/561] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:52.069039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931427e8-dd88-449a-b110-dd797b504a7d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.069039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931427e8-dd88-449a-b110-dd797b504a7d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.069039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931427e8-dd88-449a-b110-dd797b504a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.083443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-931427e8-dd88-449a-b110-dd797b504a7d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:52.084612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-931427e8-dd88-449a-b110-dd797b504a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:52.094279 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3380c8-514a-4419-985a-58acc2f1fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.094942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3380c8-514a-4419-985a-58acc2f1fe06 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.095215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3380c8-514a-4419-985a-58acc2f1fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.095483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3380c8-514a-4419-985a-58acc2f1fe06 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.096265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3380c8-514a-4419-985a-58acc2f1fe06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:52.096569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3380c8-514a-4419-985a-58acc2f1fe06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:52.098118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3380c8-514a-4419-985a-58acc2f1fe06 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:52.114450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 275/562] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:52.114450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3380c8-514a-4419-985a-58acc2f1fe06 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.157314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 288/563] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:52.157314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931427e8-dd88-449a-b110-dd797b504a7d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.217705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3380c8-514a-4419-985a-58acc2f1fe06 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.249227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931427e8-dd88-449a-b110-dd797b504a7d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.251276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394fd32-94b5-495e-ba33-969c3cf18118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.252217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394fd32-94b5-495e-ba33-969c3cf18118 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.252557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394fd32-94b5-495e-ba33-969c3cf18118 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.252900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394fd32-94b5-495e-ba33-969c3cf18118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.262991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394fd32-94b5-495e-ba33-969c3cf18118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-9394fd32-94b5-495e-ba33-969c3cf18118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:52.270875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:52.272735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 276/564] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:52.274101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394fd32-94b5-495e-ba33-969c3cf18118 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.289266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e834cfa-afa3-49ca-8167-fe632448cc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.290976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e834cfa-afa3-49ca-8167-fe632448cc78 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.291417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e834cfa-afa3-49ca-8167-fe632448cc78 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.291974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e834cfa-afa3-49ca-8167-fe632448cc78 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.299597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e834cfa-afa3-49ca-8167-fe632448cc78 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:52.301253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e834cfa-afa3-49ca-8167-fe632448cc78 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-4e834cfa-afa3-49ca-8167-fe632448cc78 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:52.315766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:52.316956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 289/565] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:43:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:52.318397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e834cfa-afa3-49ca-8167-fe632448cc78 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.371455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394fd32-94b5-495e-ba33-969c3cf18118 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.404121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd038-3102-4d79-9c12-008703d37966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.405009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd038-3102-4d79-9c12-008703d37966 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.405302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd038-3102-4d79-9c12-008703d37966 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.405579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd038-3102-4d79-9c12-008703d37966 None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/3938216005694c45bd6126415930d014/roles/b2763aed3ee84a9a9c5186ecada8844f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.412735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e834cfa-afa3-49ca-8167-fe632448cc78 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.419221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756dd038-3102-4d79-9c12-008703d37966 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=3938216005694c45bd6126415930d014, role_id=b2763aed3ee84a9a9c5186ecada8844f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:52.420667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756dd038-3102-4d79-9c12-008703d37966 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:52.435861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 277/566] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:43:52 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/3938216005694c45bd6126415930d014/roles/b2763aed3ee84a9a9c5186ecada8844f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:52.438094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd038-3102-4d79-9c12-008703d37966 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.452673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854732b-f081-47b9-b692-cc7bcb2298d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.453531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854732b-f081-47b9-b692-cc7bcb2298d9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.453807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854732b-f081-47b9-b692-cc7bcb2298d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.454036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854732b-f081-47b9-b692-cc7bcb2298d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.468998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854732b-f081-47b9-b692-cc7bcb2298d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-0854732b-f081-47b9-b692-cc7bcb2298d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:52.477060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:52.478271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:52.479323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 290/567] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:52.480120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854732b-f081-47b9-b692-cc7bcb2298d9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.557468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd038-3102-4d79-9c12-008703d37966 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.581427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854732b-f081-47b9-b692-cc7bcb2298d9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.592634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d0fe5-e860-40ad-9b0e-72595d9c4f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.593313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d0fe5-e860-40ad-9b0e-72595d9c4f37 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.593612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d0fe5-e860-40ad-9b0e-72595d9c4f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.593912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d0fe5-e860-40ad-9b0e-72595d9c4f37 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.594675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d0fe5-e860-40ad-9b0e-72595d9c4f37 None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:52.594985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d0fe5-e860-40ad-9b0e-72595d9c4f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:52.596345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d0fe5-e860-40ad-9b0e-72595d9c4f37 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:52.609764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 278/568] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:52.609764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648327-b570-464d-b7cc-70785feb224c None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.609764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648327-b570-464d-b7cc-70785feb224c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.609764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648327-b570-464d-b7cc-70785feb224c None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.609764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 279/569] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:52.609764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a648327-b570-464d-b7cc-70785feb224c None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.631838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbb72b-533d-4cda-90a1-a9ad5d92636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.632537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbb72b-533d-4cda-90a1-a9ad5d92636b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.632821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbb72b-533d-4cda-90a1-a9ad5d92636b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.633098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbb72b-533d-4cda-90a1-a9ad5d92636b None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.634116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbb72b-533d-4cda-90a1-a9ad5d92636b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:52.634428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbb72b-533d-4cda-90a1-a9ad5d92636b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:52.635936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbb72b-533d-4cda-90a1-a9ad5d92636b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:52.657909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 291/570] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 4 18:43:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:52.658992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbb72b-533d-4cda-90a1-a9ad5d92636b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.713820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a648327-b570-464d-b7cc-70785feb224c None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.747516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9e591-801c-4ee5-8b8a-d891128b1aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.748188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e591-801c-4ee5-8b8a-d891128b1aa0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.748462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e591-801c-4ee5-8b8a-d891128b1aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.748732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e591-801c-4ee5-8b8a-d891128b1aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.749831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9e591-801c-4ee5-8b8a-d891128b1aa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:52.750121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9e591-801c-4ee5-8b8a-d891128b1aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:52.751511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9e591-801c-4ee5-8b8a-d891128b1aa0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:52.758640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbb72b-533d-4cda-90a1-a9ad5d92636b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.761269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 280/571] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:52.762508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5c410-27ba-4fc8-9f98-0350cb25c5c9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.762862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5c410-27ba-4fc8-9f98-0350cb25c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.763206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5c410-27ba-4fc8-9f98-0350cb25c5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.779202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-03e5c410-27ba-4fc8-9f98-0350cb25c5c9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:52.780380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-03e5c410-27ba-4fc8-9f98-0350cb25c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:52.795353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51e278-f57a-4a27-b167-c1b114f06784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.796437 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51e278-f57a-4a27-b167-c1b114f06784 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.796809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51e278-f57a-4a27-b167-c1b114f06784 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.796977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51e278-f57a-4a27-b167-c1b114f06784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.806650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51e278-f57a-4a27-b167-c1b114f06784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:52.808081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51e278-f57a-4a27-b167-c1b114f06784 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-ac51e278-f57a-4a27-b167-c1b114f06784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:52.825622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:52.827006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:52.827921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:52.827921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:52.827921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:52.827921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:52.829591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 292/572] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:52.830638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51e278-f57a-4a27-b167-c1b114f06784 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.857379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 281/573] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:52.857379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5c410-27ba-4fc8-9f98-0350cb25c5c9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:52.926002 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51e278-f57a-4a27-b167-c1b114f06784 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.955095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5c410-27ba-4fc8-9f98-0350cb25c5c9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:52.957266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce86f6-06ee-41ca-8796-5bd77ffbdcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.958061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce86f6-06ee-41ca-8796-5bd77ffbdcc9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.958401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce86f6-06ee-41ca-8796-5bd77ffbdcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.958676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce86f6-06ee-41ca-8796-5bd77ffbdcc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.987132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85ee95-95de-4341-aaa5-c99fedd6351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:52.988202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85ee95-95de-4341-aaa5-c99fedd6351f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:52.988652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85ee95-95de-4341-aaa5-c99fedd6351f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:52.989090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85ee95-95de-4341-aaa5-c99fedd6351f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:52.998595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85ee95-95de-4341-aaa5-c99fedd6351f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.000543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85ee95-95de-4341-aaa5-c99fedd6351f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-0c85ee95-95de-4341-aaa5-c99fedd6351f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:53.017606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:53.018659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:53.019913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:53.019913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:53.019913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:53.019913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:53.019913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 282/574] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:53.019913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85ee95-95de-4341-aaa5-c99fedd6351f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.025839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce86f6-06ee-41ca-8796-5bd77ffbdcc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.027284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce86f6-06ee-41ca-8796-5bd77ffbdcc9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.122401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85ee95-95de-4341-aaa5-c99fedd6351f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.135629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 293/575] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:53.136290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce86f6-06ee-41ca-8796-5bd77ffbdcc9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.160696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dacfab-1f77-4e60-b289-9956019bb1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.161407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dacfab-1f77-4e60-b289-9956019bb1e1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.161686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dacfab-1f77-4e60-b289-9956019bb1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.161961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dacfab-1f77-4e60-b289-9956019bb1e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.162703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dacfab-1f77-4e60-b289-9956019bb1e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:53.163017 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dacfab-1f77-4e60-b289-9956019bb1e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.164397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dacfab-1f77-4e60-b289-9956019bb1e1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.179923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 283/576] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:53.179923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dacfab-1f77-4e60-b289-9956019bb1e1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.231284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce86f6-06ee-41ca-8796-5bd77ffbdcc9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.264272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7ba51-1254-4930-bc0f-8121c0c36698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.265085 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ba51-1254-4930-bc0f-8121c0c36698 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.265385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ba51-1254-4930-bc0f-8121c0c36698 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.265660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ba51-1254-4930-bc0f-8121c0c36698 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.276350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7ba51-1254-4930-bc0f-8121c0c36698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:53.276515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dacfab-1f77-4e60-b289-9956019bb1e1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-88d7ba51-1254-4930-bc0f-8121c0c36698 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:53.284027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:53.285274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:53.286136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:53.289592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 294/577] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:53.290600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7ba51-1254-4930-bc0f-8121c0c36698 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.309258 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e177a11-89df-40b6-b5e9-c5a4dd0da71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.309966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e177a11-89df-40b6-b5e9-c5a4dd0da71c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.310246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e177a11-89df-40b6-b5e9-c5a4dd0da71c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.310515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e177a11-89df-40b6-b5e9-c5a4dd0da71c None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.311257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e177a11-89df-40b6-b5e9-c5a4dd0da71c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:53.311560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e177a11-89df-40b6-b5e9-c5a4dd0da71c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.313021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e177a11-89df-40b6-b5e9-c5a4dd0da71c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.324452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 284/578] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:53.325983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e177a11-89df-40b6-b5e9-c5a4dd0da71c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.387073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7ba51-1254-4930-bc0f-8121c0c36698 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.419837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf0a14-255c-45a4-9f56-eda799397c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.420640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e177a11-89df-40b6-b5e9-c5a4dd0da71c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.420748 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf0a14-255c-45a4-9f56-eda799397c89 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.420945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf0a14-255c-45a4-9f56-eda799397c89 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.421219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf0a14-255c-45a4-9f56-eda799397c89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.431823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf0a14-255c-45a4-9f56-eda799397c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.433313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf0a14-255c-45a4-9f56-eda799397c89 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-3eaf0a14-255c-45a4-9f56-eda799397c89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:53.450253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:53.451391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:53.452441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:53.452441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:53.452441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:53.452441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:53.452441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 295/579] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:53.457157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf0a14-255c-45a4-9f56-eda799397c89 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.465037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2910f5-e49b-4836-afb1-930aea6f469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.466156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2910f5-e49b-4836-afb1-930aea6f469c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.466433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2910f5-e49b-4836-afb1-930aea6f469c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.466700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2910f5-e49b-4836-afb1-930aea6f469c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.474339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2910f5-e49b-4836-afb1-930aea6f469c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.475846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2910f5-e49b-4836-afb1-930aea6f469c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-0e2910f5-e49b-4836-afb1-930aea6f469c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:53.490500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:53.491686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 285/580] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:53.492666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2910f5-e49b-4836-afb1-930aea6f469c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.560914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf0a14-255c-45a4-9f56-eda799397c89 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.594453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2910f5-e49b-4836-afb1-930aea6f469c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.599039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83e4ea-9327-4ac4-b15e-9e822668e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.600243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e4ea-9327-4ac4-b15e-9e822668e10c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.600685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e4ea-9327-4ac4-b15e-9e822668e10c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.601101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e4ea-9327-4ac4-b15e-9e822668e10c None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.602482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83e4ea-9327-4ac4-b15e-9e822668e10c None admin] RBAC: Adding query filter params (name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:53.602934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83e4ea-9327-4ac4-b15e-9e822668e10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.604896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83e4ea-9327-4ac4-b15e-9e822668e10c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.617860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 296/581] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:53.618917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83e4ea-9327-4ac4-b15e-9e822668e10c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.627799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22efcab-337d-414b-bd31-b6d936a1c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.628727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22efcab-337d-414b-bd31-b6d936a1c5b1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.629008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22efcab-337d-414b-bd31-b6d936a1c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.629276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22efcab-337d-414b-bd31-b6d936a1c5b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.636531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22efcab-337d-414b-bd31-b6d936a1c5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.638080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22efcab-337d-414b-bd31-b6d936a1c5b1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-b22efcab-337d-414b-bd31-b6d936a1c5b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:53.652209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:53.653207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:53.654391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 286/582] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:53.655058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22efcab-337d-414b-bd31-b6d936a1c5b1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.724441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83e4ea-9327-4ac4-b15e-9e822668e10c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.752935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22efcab-337d-414b-bd31-b6d936a1c5b1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.757455 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f392bd-de08-45c6-b2f0-7e5f1988822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.758201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f392bd-de08-45c6-b2f0-7e5f1988822e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.758473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f392bd-de08-45c6-b2f0-7e5f1988822e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.758781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f392bd-de08-45c6-b2f0-7e5f1988822e None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.759525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f392bd-de08-45c6-b2f0-7e5f1988822e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:53.759831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f392bd-de08-45c6-b2f0-7e5f1988822e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.761236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f392bd-de08-45c6-b2f0-7e5f1988822e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.777245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 297/583] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:53.777245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f392bd-de08-45c6-b2f0-7e5f1988822e None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.791049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea014af-4a91-43fb-9a55-13ca110ce9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.791794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea014af-4a91-43fb-9a55-13ca110ce9a8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.792077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea014af-4a91-43fb-9a55-13ca110ce9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.792347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea014af-4a91-43fb-9a55-13ca110ce9a8 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.793194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea014af-4a91-43fb-9a55-13ca110ce9a8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:53.793536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea014af-4a91-43fb-9a55-13ca110ce9a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.794952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea014af-4a91-43fb-9a55-13ca110ce9a8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.816422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 287/584] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:53.816422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea014af-4a91-43fb-9a55-13ca110ce9a8 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.871669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f392bd-de08-45c6-b2f0-7e5f1988822e None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.904948 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df22d01-6227-4adb-8dfb-ce6ad0e8494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.905719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df22d01-6227-4adb-8dfb-ce6ad0e8494a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.905993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df22d01-6227-4adb-8dfb-ce6ad0e8494a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.906260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df22d01-6227-4adb-8dfb-ce6ad0e8494a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.910226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea014af-4a91-43fb-9a55-13ca110ce9a8 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:53.916271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df22d01-6227-4adb-8dfb-ce6ad0e8494a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.917793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df22d01-6227-4adb-8dfb-ce6ad0e8494a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-0df22d01-6227-4adb-8dfb-ce6ad0e8494a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:53.935122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:53.936313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:53.937222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:53.937222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:53.937222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:53.937222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:53.937222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 298/585] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:53.937222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df22d01-6227-4adb-8dfb-ce6ad0e8494a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:53.951265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896ae40-587d-43d6-9233-301b05e2a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:53.952108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896ae40-587d-43d6-9233-301b05e2a89f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:53.952773 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896ae40-587d-43d6-9233-301b05e2a89f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:53.953054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896ae40-587d-43d6-9233-301b05e2a89f None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:53.954131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896ae40-587d-43d6-9233-301b05e2a89f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:53.954446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896ae40-587d-43d6-9233-301b05e2a89f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:53.955898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896ae40-587d-43d6-9233-301b05e2a89f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:53.974096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 288/586] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:53.974959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896ae40-587d-43d6-9233-301b05e2a89f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.041690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df22d01-6227-4adb-8dfb-ce6ad0e8494a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.068935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896ae40-587d-43d6-9233-301b05e2a89f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.074857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa029ca-459a-4ca4-88cb-acafdf4e40b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.075658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa029ca-459a-4ca4-88cb-acafdf4e40b9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.075941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa029ca-459a-4ca4-88cb-acafdf4e40b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.076212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa029ca-459a-4ca4-88cb-acafdf4e40b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.083092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa029ca-459a-4ca4-88cb-acafdf4e40b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.084559 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa029ca-459a-4ca4-88cb-acafdf4e40b9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-8fa029ca-459a-4ca4-88cb-acafdf4e40b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:54.098018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:54.098929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:54.099864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:54.099864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:54.099864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:54.099864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:54.099864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:54.099864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:54.099864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:54.099864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:54.099864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 299/587] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:54.100387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa029ca-459a-4ca4-88cb-acafdf4e40b9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.106479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e99114-ec34-4790-ac90-f437e92716c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.107285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e99114-ec34-4790-ac90-f437e92716c4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.107558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e99114-ec34-4790-ac90-f437e92716c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.107824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e99114-ec34-4790-ac90-f437e92716c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.118561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e99114-ec34-4790-ac90-f437e92716c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.119990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e99114-ec34-4790-ac90-f437e92716c4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-02e99114-ec34-4790-ac90-f437e92716c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:54.137756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:54.138755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:54.139647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:54.139647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:54.139647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:54.139647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:54.143519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 289/588] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:54.144424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e99114-ec34-4790-ac90-f437e92716c4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.197465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa029ca-459a-4ca4-88cb-acafdf4e40b9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.231401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa000c-9fdc-4bc6-82ac-00bdda25da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.232072 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa000c-9fdc-4bc6-82ac-00bdda25da26 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.232341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa000c-9fdc-4bc6-82ac-00bdda25da26 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.232630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa000c-9fdc-4bc6-82ac-00bdda25da26 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.233384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa000c-9fdc-4bc6-82ac-00bdda25da26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:54.233697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa000c-9fdc-4bc6-82ac-00bdda25da26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.235078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa000c-9fdc-4bc6-82ac-00bdda25da26 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.241381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e99114-ec34-4790-ac90-f437e92716c4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.251558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 300/589] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:54.251558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa000c-9fdc-4bc6-82ac-00bdda25da26 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.274721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaebaae-40e3-4701-ab4e-409b1cca238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.275495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaebaae-40e3-4701-ab4e-409b1cca238e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.275787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaebaae-40e3-4701-ab4e-409b1cca238e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.276040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaebaae-40e3-4701-ab4e-409b1cca238e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.286201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaebaae-40e3-4701-ab4e-409b1cca238e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.287642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaebaae-40e3-4701-ab4e-409b1cca238e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-dcaebaae-40e3-4701-ab4e-409b1cca238e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:54.305029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:54.305979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:54.306866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:54.306866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:54.306866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:54.306866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:54.309459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 290/590] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:54.311005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaebaae-40e3-4701-ab4e-409b1cca238e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.348745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa000c-9fdc-4bc6-82ac-00bdda25da26 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.383019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458469a6-217f-4ff1-a9a4-74ac52e190b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.383999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458469a6-217f-4ff1-a9a4-74ac52e190b4 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.384494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458469a6-217f-4ff1-a9a4-74ac52e190b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.384955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458469a6-217f-4ff1-a9a4-74ac52e190b4 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.385958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458469a6-217f-4ff1-a9a4-74ac52e190b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:54.386457 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458469a6-217f-4ff1-a9a4-74ac52e190b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.388069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458469a6-217f-4ff1-a9a4-74ac52e190b4 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.399763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 301/591] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:54.401020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458469a6-217f-4ff1-a9a4-74ac52e190b4 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.412279 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaebaae-40e3-4701-ab4e-409b1cca238e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.449817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfd6ed-2a60-4230-8f14-865217a1bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.450425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfd6ed-2a60-4230-8f14-865217a1bb19 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.450731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfd6ed-2a60-4230-8f14-865217a1bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.450985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfd6ed-2a60-4230-8f14-865217a1bb19 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.451717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfd6ed-2a60-4230-8f14-865217a1bb19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:54.452026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfd6ed-2a60-4230-8f14-865217a1bb19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.453413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfd6ed-2a60-4230-8f14-865217a1bb19 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.464921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 291/592] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:54.465829 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfd6ed-2a60-4230-8f14-865217a1bb19 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.502068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458469a6-217f-4ff1-a9a4-74ac52e190b4 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.535272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a0b7-0fbc-4178-ad72-bb40474bbe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.536069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a0b7-0fbc-4178-ad72-bb40474bbe09 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.536349 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a0b7-0fbc-4178-ad72-bb40474bbe09 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.536618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a0b7-0fbc-4178-ad72-bb40474bbe09 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.544136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90a0b7-0fbc-4178-ad72-bb40474bbe09 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.545597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90a0b7-0fbc-4178-ad72-bb40474bbe09 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-ab90a0b7-0fbc-4178-ad72-bb40474bbe09 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:54.559612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:54.560580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 302/593] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:54.566924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a0b7-0fbc-4178-ad72-bb40474bbe09 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.567585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfd6ed-2a60-4230-8f14-865217a1bb19 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.603937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c3d5a-db1f-412c-9a67-cb9c23575381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.604646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c3d5a-db1f-412c-9a67-cb9c23575381 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.604930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c3d5a-db1f-412c-9a67-cb9c23575381 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.605210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c3d5a-db1f-412c-9a67-cb9c23575381 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.605986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c3d5a-db1f-412c-9a67-cb9c23575381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:54.606301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c3d5a-db1f-412c-9a67-cb9c23575381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.607713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c3d5a-db1f-412c-9a67-cb9c23575381 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.622429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 292/594] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:54.623272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c3d5a-db1f-412c-9a67-cb9c23575381 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.672671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a0b7-0fbc-4178-ad72-bb40474bbe09 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.703646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2d215-7ec6-47d7-bfee-541109b639fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.704226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2d215-7ec6-47d7-bfee-541109b639fb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.704505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2d215-7ec6-47d7-bfee-541109b639fb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.704776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2d215-7ec6-47d7-bfee-541109b639fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.705650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2d215-7ec6-47d7-bfee-541109b639fb None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=d94a895e3a3547ff9cf35d808c595071) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:54.705958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2d215-7ec6-47d7-bfee-541109b639fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.707428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2d215-7ec6-47d7-bfee-541109b639fb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.712879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 303/595] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/role_assignments?user.id=d94a895e3a3547ff9cf35d808c595071&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:54.713681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2d215-7ec6-47d7-bfee-541109b639fb None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.716749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c3d5a-db1f-412c-9a67-cb9c23575381 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.762118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0c17-b005-49a8-b39d-613a1a1bcabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.762946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0c17-b005-49a8-b39d-613a1a1bcabd None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.763223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0c17-b005-49a8-b39d-613a1a1bcabd None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.763491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0c17-b005-49a8-b39d-613a1a1bcabd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.771108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f0c17-b005-49a8-b39d-613a1a1bcabd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.772612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f0c17-b005-49a8-b39d-613a1a1bcabd None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-909f0c17-b005-49a8-b39d-613a1a1bcabd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:54.789034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:54.790341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 293/596] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:54.791422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0c17-b005-49a8-b39d-613a1a1bcabd None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.838444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2d215-7ec6-47d7-bfee-541109b639fb None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.874024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec61a19-5c12-470d-a17f-072a0dcb511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.875253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec61a19-5c12-470d-a17f-072a0dcb511d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.875631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec61a19-5c12-470d-a17f-072a0dcb511d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.876029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec61a19-5c12-470d-a17f-072a0dcb511d None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.877010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec61a19-5c12-470d-a17f-072a0dcb511d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:54.877459 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec61a19-5c12-470d-a17f-072a0dcb511d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.879030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec61a19-5c12-470d-a17f-072a0dcb511d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.894820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0c17-b005-49a8-b39d-613a1a1bcabd None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:54.897910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 304/597] 10.222.0.35 () {56 vars in 1139 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:54.899286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a0a9e-184f-4da6-a85d-c01b5178d000 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.899572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a0a9e-184f-4da6-a85d-c01b5178d000 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.899851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a0a9e-184f-4da6-a85d-c01b5178d000 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.901254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 305/598] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:54.901824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a0a9e-184f-4da6-a85d-c01b5178d000 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:54.938357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65533a9-45cf-4633-b52b-b50a4c60fca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:54.939173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65533a9-45cf-4633-b52b-b50a4c60fca4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:54.939451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65533a9-45cf-4633-b52b-b50a4c60fca4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:54.939730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65533a9-45cf-4633-b52b-b50a4c60fca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:54.946471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65533a9-45cf-4633-b52b-b50a4c60fca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:54.947918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65533a9-45cf-4633-b52b-b50a4c60fca4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-f65533a9-45cf-4633-b52b-b50a4c60fca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:54.961983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:54.963050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:54.963959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:54.963959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:54.963959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:54.963959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:54.963959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:54.963959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:54.963959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:54.963959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:54.963959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 294/599] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:54.964437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65533a9-45cf-4633-b52b-b50a4c60fca4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.008867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a0a9e-184f-4da6-a85d-c01b5178d000 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.043583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1877b-635b-4f14-97ce-8cef3136d70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.044494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1877b-635b-4f14-97ce-8cef3136d70f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.044775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1877b-635b-4f14-97ce-8cef3136d70f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.045062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1877b-635b-4f14-97ce-8cef3136d70f None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.045894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1877b-635b-4f14-97ce-8cef3136d70f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:55.046225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1877b-635b-4f14-97ce-8cef3136d70f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.047646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1877b-635b-4f14-97ce-8cef3136d70f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.063824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 306/600] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:55.064034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65533a9-45cf-4633-b52b-b50a4c60fca4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.064119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048781c-de22-4852-9e5e-2285386cd76b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.064119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048781c-de22-4852-9e5e-2285386cd76b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.064119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048781c-de22-4852-9e5e-2285386cd76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.079624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5048781c-de22-4852-9e5e-2285386cd76b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:55.080953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5048781c-de22-4852-9e5e-2285386cd76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:55.093222 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801c2ee-8052-4879-befb-747c63467ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.094064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801c2ee-8052-4879-befb-747c63467ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.094345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801c2ee-8052-4879-befb-747c63467ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.094620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801c2ee-8052-4879-befb-747c63467ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.104703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801c2ee-8052-4879-befb-747c63467ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.106186 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801c2ee-8052-4879-befb-747c63467ec9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8801c2ee-8052-4879-befb-747c63467ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:55.126321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:55.127298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:55.128200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:55.128200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:55.128200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:55.128200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:55.128200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 295/601] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:55.129058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801c2ee-8052-4879-befb-747c63467ec9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.149934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 307/602] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:55.150946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048781c-de22-4852-9e5e-2285386cd76b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.222602 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801c2ee-8052-4879-befb-747c63467ec9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.243294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048781c-de22-4852-9e5e-2285386cd76b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.254905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee3d7b-f9fd-47b9-91c9-38454aa4c842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.255674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee3d7b-f9fd-47b9-91c9-38454aa4c842 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.256069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee3d7b-f9fd-47b9-91c9-38454aa4c842 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.256414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee3d7b-f9fd-47b9-91c9-38454aa4c842 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.257346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee3d7b-f9fd-47b9-91c9-38454aa4c842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:55.257777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee3d7b-f9fd-47b9-91c9-38454aa4c842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.259264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee3d7b-f9fd-47b9-91c9-38454aa4c842 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.270405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 296/603] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:55.271295 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee3d7b-f9fd-47b9-91c9-38454aa4c842 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.276261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830409a3-839b-46e6-9517-fcbd947a1d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.277370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830409a3-839b-46e6-9517-fcbd947a1d59 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.277792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830409a3-839b-46e6-9517-fcbd947a1d59 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.278212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830409a3-839b-46e6-9517-fcbd947a1d59 None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/432759ff503942e7ae6941f9d4b951b4/roles/b2763aed3ee84a9a9c5186ecada8844f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.292385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830409a3-839b-46e6-9517-fcbd947a1d59 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=432759ff503942e7ae6941f9d4b951b4, role_id=b2763aed3ee84a9a9c5186ecada8844f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.294054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830409a3-839b-46e6-9517-fcbd947a1d59 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.317385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 308/604] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:43:55 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/432759ff503942e7ae6941f9d4b951b4/roles/b2763aed3ee84a9a9c5186ecada8844f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:55.318423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830409a3-839b-46e6-9517-fcbd947a1d59 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.374975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee3d7b-f9fd-47b9-91c9-38454aa4c842 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.411856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfdc8a-817f-4503-817b-a02dc08cb5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.412604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfdc8a-817f-4503-817b-a02dc08cb5d9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.412886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfdc8a-817f-4503-817b-a02dc08cb5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.413160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfdc8a-817f-4503-817b-a02dc08cb5d9 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.413951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfdc8a-817f-4503-817b-a02dc08cb5d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:55.414263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfdc8a-817f-4503-817b-a02dc08cb5d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.415685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfdc8a-817f-4503-817b-a02dc08cb5d9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.428701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830409a3-839b-46e6-9517-fcbd947a1d59 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.433433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 297/605] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:55.434382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfdc8a-817f-4503-817b-a02dc08cb5d9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.466550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824383f9-27c6-4985-9179-a25edf787bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.467762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824383f9-27c6-4985-9179-a25edf787bcb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.468248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824383f9-27c6-4985-9179-a25edf787bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.468731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824383f9-27c6-4985-9179-a25edf787bcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.480615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824383f9-27c6-4985-9179-a25edf787bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-824383f9-27c6-4985-9179-a25edf787bcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:55.488945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:55.489966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:55.490803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:55.498290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 309/606] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:55.499851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824383f9-27c6-4985-9179-a25edf787bcb None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.539627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfdc8a-817f-4503-817b-a02dc08cb5d9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.573166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ca88d-07bf-4481-9c15-b1a07fd45abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.574483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ca88d-07bf-4481-9c15-b1a07fd45abd None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.574985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ca88d-07bf-4481-9c15-b1a07fd45abd None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.575445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ca88d-07bf-4481-9c15-b1a07fd45abd None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/63b338ae7e374ba5a7542c5a53deb416/roles/b2763aed3ee84a9a9c5186ecada8844f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.590355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ca88d-07bf-4481-9c15-b1a07fd45abd None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=63b338ae7e374ba5a7542c5a53deb416, role_id=b2763aed3ee84a9a9c5186ecada8844f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.592090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ca88d-07bf-4481-9c15-b1a07fd45abd None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.611594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824383f9-27c6-4985-9179-a25edf787bcb None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.612656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 298/607] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:43:55 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/63b338ae7e374ba5a7542c5a53deb416/roles/b2763aed3ee84a9a9c5186ecada8844f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:43:55.614067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ca88d-07bf-4481-9c15-b1a07fd45abd None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.649156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495aff-662f-47c7-afca-995305704826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.650266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495aff-662f-47c7-afca-995305704826 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.650640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495aff-662f-47c7-afca-995305704826 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.650982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495aff-662f-47c7-afca-995305704826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.658635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac495aff-662f-47c7-afca-995305704826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.660303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac495aff-662f-47c7-afca-995305704826 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-ac495aff-662f-47c7-afca-995305704826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:55.676682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:55.678134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:55.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:55.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:55.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:55.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:55.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:55.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:55.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:55.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:55.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 310/608] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:55.683915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495aff-662f-47c7-afca-995305704826 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.736397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ca88d-07bf-4481-9c15-b1a07fd45abd None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.777440 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993bed2-fe2a-40e6-9e45-cb5fa613f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.778512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993bed2-fe2a-40e6-9e45-cb5fa613f716 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.778974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993bed2-fe2a-40e6-9e45-cb5fa613f716 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.779921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993bed2-fe2a-40e6-9e45-cb5fa613f716 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.780920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993bed2-fe2a-40e6-9e45-cb5fa613f716 None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:55.781762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993bed2-fe2a-40e6-9e45-cb5fa613f716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.783550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993bed2-fe2a-40e6-9e45-cb5fa613f716 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.793808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 299/609] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:55.800453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993bed2-fe2a-40e6-9e45-cb5fa613f716 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.873687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495aff-662f-47c7-afca-995305704826 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.918337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993bed2-fe2a-40e6-9e45-cb5fa613f716 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:55.918680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9aba-4733-4ef3-85d7-f0cf4e9f5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.919569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9aba-4733-4ef3-85d7-f0cf4e9f5d71 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.920167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9aba-4733-4ef3-85d7-f0cf4e9f5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.921418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9aba-4733-4ef3-85d7-f0cf4e9f5d71 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.922433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a9aba-4733-4ef3-85d7-f0cf4e9f5d71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:55.922954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a9aba-4733-4ef3-85d7-f0cf4e9f5d71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.924601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a9aba-4733-4ef3-85d7-f0cf4e9f5d71 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.940244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 311/610] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:55.945687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9aba-4733-4ef3-85d7-f0cf4e9f5d71 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:55.954387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb53a2e-9850-47f2-b626-5111b4d80f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:55.955273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb53a2e-9850-47f2-b626-5111b4d80f5f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:55.955555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb53a2e-9850-47f2-b626-5111b4d80f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:55.955824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb53a2e-9850-47f2-b626-5111b4d80f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:55.968366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb53a2e-9850-47f2-b626-5111b4d80f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:55.969918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb53a2e-9850-47f2-b626-5111b4d80f5f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-cdb53a2e-9850-47f2-b626-5111b4d80f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:55.988084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:55.989016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:55.989974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:55.989974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:55.989974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:55.989974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:55.993687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 300/611] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:55.995390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb53a2e-9850-47f2-b626-5111b4d80f5f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:56.108023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb53a2e-9850-47f2-b626-5111b4d80f5f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:56.118076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9aba-4733-4ef3-85d7-f0cf4e9f5d71 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:56.150904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f65be-e6ce-45b0-80e2-2b685309105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:56.151910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f65be-e6ce-45b0-80e2-2b685309105f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:56.152384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f65be-e6ce-45b0-80e2-2b685309105f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:56.152818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f65be-e6ce-45b0-80e2-2b685309105f None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:56.153777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f65be-e6ce-45b0-80e2-2b685309105f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:56.154261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f65be-e6ce-45b0-80e2-2b685309105f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:56.155847 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f65be-e6ce-45b0-80e2-2b685309105f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:56.168847 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba065-63a0-46e1-94a9-cc660611441a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:56.169808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba065-63a0-46e1-94a9-cc660611441a None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:56.170089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba065-63a0-46e1-94a9-cc660611441a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:56.170418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba065-63a0-46e1-94a9-cc660611441a None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/94b338c27d664f51bc9de29c9c6ba40e/roles/b2763aed3ee84a9a9c5186ecada8844f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:56.170866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 301/612] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:56.178422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f65be-e6ce-45b0-80e2-2b685309105f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:56.186518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ba065-63a0-46e1-94a9-cc660611441a None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=94b338c27d664f51bc9de29c9c6ba40e, role_id=b2763aed3ee84a9a9c5186ecada8844f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:56.188183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ba065-63a0-46e1-94a9-cc660611441a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:56.207252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 312/613] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:43:55 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/94b338c27d664f51bc9de29c9c6ba40e/roles/b2763aed3ee84a9a9c5186ecada8844f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:43:56.301063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f65be-e6ce-45b0-80e2-2b685309105f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:56.337243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22757d7-5b08-4216-b26c-091ba06f8985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:56.338409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22757d7-5b08-4216-b26c-091ba06f8985 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:56.338812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22757d7-5b08-4216-b26c-091ba06f8985 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:56.339215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22757d7-5b08-4216-b26c-091ba06f8985 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:56.357696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22757d7-5b08-4216-b26c-091ba06f8985 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:56.359590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22757d7-5b08-4216-b26c-091ba06f8985 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-d22757d7-5b08-4216-b26c-091ba06f8985 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:56.381328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:56.383068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:43:56.384210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:56.386439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 302/614] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 4 18:43:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:56.392501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba065-63a0-46e1-94a9-cc660611441a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:56.501479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba065-63a0-46e1-94a9-cc660611441a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:56.536789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f876924-0de7-4885-90b2-ae331f7958d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:56.537796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f876924-0de7-4885-90b2-ae331f7958d3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:56.538218 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f876924-0de7-4885-90b2-ae331f7958d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:56.538653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f876924-0de7-4885-90b2-ae331f7958d3 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:56.539660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f876924-0de7-4885-90b2-ae331f7958d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:56.540106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f876924-0de7-4885-90b2-ae331f7958d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:56.541772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f876924-0de7-4885-90b2-ae331f7958d3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:56.562977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 313/615] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 4 18:43:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:56.568205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22757d7-5b08-4216-b26c-091ba06f8985 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:56.676056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22757d7-5b08-4216-b26c-091ba06f8985 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:56.716247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185158-d19a-458e-a312-95cd32606d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:56.717152 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185158-d19a-458e-a312-95cd32606d5e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:56.717590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185158-d19a-458e-a312-95cd32606d5e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:56.718026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185158-d19a-458e-a312-95cd32606d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:56.794545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b185158-d19a-458e-a312-95cd32606d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:56.796238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b185158-d19a-458e-a312-95cd32606d5e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:56.892141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 303/616] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:56.897527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f876924-0de7-4885-90b2-ae331f7958d3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:57.022084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f876924-0de7-4885-90b2-ae331f7958d3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:57.060618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d9eed-10e6-48a9-b1bb-de87af9b1406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:57.061679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d9eed-10e6-48a9-b1bb-de87af9b1406 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:57.062097 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d9eed-10e6-48a9-b1bb-de87af9b1406 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:57.062506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d9eed-10e6-48a9-b1bb-de87af9b1406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:57.072612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d9eed-10e6-48a9-b1bb-de87af9b1406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:57.074292 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d9eed-10e6-48a9-b1bb-de87af9b1406 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-321d9eed-10e6-48a9-b1bb-de87af9b1406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:57.095666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:57.096780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:57.097924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:57.097924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:57.097924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:57.097924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:57.099832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 314/617] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:57.105135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185158-d19a-458e-a312-95cd32606d5e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:57.205760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185158-d19a-458e-a312-95cd32606d5e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:57.248472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d17f1-c124-4798-ac17-6a03a1e485eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:57.249737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d17f1-c124-4798-ac17-6a03a1e485eb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:57.250183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d17f1-c124-4798-ac17-6a03a1e485eb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:57.250588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d17f1-c124-4798-ac17-6a03a1e485eb None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:57.251477 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d17f1-c124-4798-ac17-6a03a1e485eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:57.251923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d17f1-c124-4798-ac17-6a03a1e485eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:57.253530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d17f1-c124-4798-ac17-6a03a1e485eb None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:57.269836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 304/618] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:57.275506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d9eed-10e6-48a9-b1bb-de87af9b1406 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:57.375075 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d9eed-10e6-48a9-b1bb-de87af9b1406 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:57.394113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09660f01-80d1-44f7-b65a-76cfa1a40088 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:57.394950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09660f01-80d1-44f7-b65a-76cfa1a40088 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:57.395392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09660f01-80d1-44f7-b65a-76cfa1a40088 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:57.396889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 305/619] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:57.402177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173c2f6-0203-4634-81d4-fc7b9ccb96a6 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:57.402470 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173c2f6-0203-4634-81d4-fc7b9ccb96a6 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:57.402754 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173c2f6-0203-4634-81d4-fc7b9ccb96a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:57.414058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79529d-b18e-42c8-b4dc-d534c4a125ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:57.415069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79529d-b18e-42c8-b4dc-d534c4a125ba None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:57.415507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79529d-b18e-42c8-b4dc-d534c4a125ba None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:57.415915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79529d-b18e-42c8-b4dc-d534c4a125ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:57.422837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79529d-b18e-42c8-b4dc-d534c4a125ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:57.424503 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79529d-b18e-42c8-b4dc-d534c4a125ba None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-7b79529d-b18e-42c8-b4dc-d534c4a125ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:57.438126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:57.439158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:57.440062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:57.440062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:57.440062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:57.440062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:57.440062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:57.440062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:57.440062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:57.440062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:57.442420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-b173c2f6-0203-4634-81d4-fc7b9ccb96a6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:57.442630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 315/620] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:57.445748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b173c2f6-0203-4634-81d4-fc7b9ccb96a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:57.449010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79529d-b18e-42c8-b4dc-d534c4a125ba None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:57.567402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 306/621] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:57.572025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79529d-b18e-42c8-b4dc-d534c4a125ba None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:57.606082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173c2f6-0203-4634-81d4-fc7b9ccb96a6 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:57.608123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a43af-1822-49ce-b6e2-24077fd5c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:57.609480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a43af-1822-49ce-b6e2-24077fd5c43c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:57.609755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a43af-1822-49ce-b6e2-24077fd5c43c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:57.614169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a43af-1822-49ce-b6e2-24077fd5c43c None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:57.614997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a43af-1822-49ce-b6e2-24077fd5c43c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:57.615309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a43af-1822-49ce-b6e2-24077fd5c43c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:57.616757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a43af-1822-49ce-b6e2-24077fd5c43c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:57.644595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 316/622] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:57.650427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a43af-1822-49ce-b6e2-24077fd5c43c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:57.761072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173c2f6-0203-4634-81d4-fc7b9ccb96a6 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:57.797317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a43af-1822-49ce-b6e2-24077fd5c43c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:57.834619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aee82-1cbc-4025-b4b4-2d4de06500f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:57.835289 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aee82-1cbc-4025-b4b4-2d4de06500f3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:57.835564 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aee82-1cbc-4025-b4b4-2d4de06500f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:57.835834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aee82-1cbc-4025-b4b4-2d4de06500f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:57.836673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aee82-1cbc-4025-b4b4-2d4de06500f3 None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=3938216005694c45bd6126415930d014) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:57.836978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aee82-1cbc-4025-b4b4-2d4de06500f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:57.838479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aee82-1cbc-4025-b4b4-2d4de06500f3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:57.845541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e542ae0-e692-4551-ac42-a1d8b09cf36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:57.846356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e542ae0-e692-4551-ac42-a1d8b09cf36a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:57.846632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e542ae0-e692-4551-ac42-a1d8b09cf36a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:57.846895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e542ae0-e692-4551-ac42-a1d8b09cf36a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:57.853349 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 317/623] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:43:57 2022] GET /identity/v3/role_assignments?user.id=3938216005694c45bd6126415930d014&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:57.861599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e542ae0-e692-4551-ac42-a1d8b09cf36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-9e542ae0-e692-4551-ac42-a1d8b09cf36a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:57.869728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:57.870785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:57.871672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 307/624] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:57.882506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aee82-1cbc-4025-b4b4-2d4de06500f3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:57.996970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76b3e9-e321-4cce-9237-e98cd564dd93 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:57.997341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76b3e9-e321-4cce-9237-e98cd564dd93 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:57.997723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76b3e9-e321-4cce-9237-e98cd564dd93 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.000599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 308/625] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:43:58.017765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a878d8-f26b-45eb-943c-17521ffd6446 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.018068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a878d8-f26b-45eb-943c-17521ffd6446 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.018234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a878d8-f26b-45eb-943c-17521ffd6446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.049453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-43a878d8-f26b-45eb-943c-17521ffd6446 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:58.050537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-43a878d8-f26b-45eb-943c-17521ffd6446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:58.056226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aee82-1cbc-4025-b4b4-2d4de06500f3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:58.102954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a37cf-e32c-4f8f-99a7-11635eff1834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:58.104038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a37cf-e32c-4f8f-99a7-11635eff1834 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.104530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a37cf-e32c-4f8f-99a7-11635eff1834 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.105024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a37cf-e32c-4f8f-99a7-11635eff1834 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.106021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a37cf-e32c-4f8f-99a7-11635eff1834 None admin] RBAC: Adding query filter params (name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:58.106543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a37cf-e32c-4f8f-99a7-11635eff1834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:58.108588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a37cf-e32c-4f8f-99a7-11635eff1834 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:58.122787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 318/626] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:58.128967 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a37cf-e32c-4f8f-99a7-11635eff1834 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.150655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 309/627] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:58.173572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a878d8-f26b-45eb-943c-17521ffd6446 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.227880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a37cf-e32c-4f8f-99a7-11635eff1834 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:58.261030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a67c9-f6b6-43bc-9cec-6c6e0109f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:58.261952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a67c9-f6b6-43bc-9cec-6c6e0109f666 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.262228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a67c9-f6b6-43bc-9cec-6c6e0109f666 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.262498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a67c9-f6b6-43bc-9cec-6c6e0109f666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.273231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a67c9-f6b6-43bc-9cec-6c6e0109f666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:58.273436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a878d8-f26b-45eb-943c-17521ffd6446 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:58.274766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a67c9-f6b6-43bc-9cec-6c6e0109f666 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-9d4a67c9-f6b6-43bc-9cec-6c6e0109f666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:58.291993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:58.292949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:58.293889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:58.293889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:58.293889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:58.293889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:58.297052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 319/628] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:58.298998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a67c9-f6b6-43bc-9cec-6c6e0109f666 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.307178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227dae6-ea46-4df0-b9c3-19ec55d07752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:58.307988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227dae6-ea46-4df0-b9c3-19ec55d07752 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.308266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227dae6-ea46-4df0-b9c3-19ec55d07752 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.308538 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227dae6-ea46-4df0-b9c3-19ec55d07752 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.318943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227dae6-ea46-4df0-b9c3-19ec55d07752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-0227dae6-ea46-4df0-b9c3-19ec55d07752 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:58.326751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:58.328924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:58.331018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 310/629] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:43:58.341340 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227dae6-ea46-4df0-b9c3-19ec55d07752 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.401928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a67c9-f6b6-43bc-9cec-6c6e0109f666 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:58.436170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fedf7b-e06e-411b-9d00-17efdb6def24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:58.436833 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fedf7b-e06e-411b-9d00-17efdb6def24 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.437109 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fedf7b-e06e-411b-9d00-17efdb6def24 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.437278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227dae6-ea46-4df0-b9c3-19ec55d07752 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:58.437813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fedf7b-e06e-411b-9d00-17efdb6def24 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.438120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fedf7b-e06e-411b-9d00-17efdb6def24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:58.438421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fedf7b-e06e-411b-9d00-17efdb6def24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:58.439864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fedf7b-e06e-411b-9d00-17efdb6def24 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:58.452993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 320/630] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:58.463275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fedf7b-e06e-411b-9d00-17efdb6def24 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.473092 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51954-75f6-4592-b705-5713910984e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:58.473807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51954-75f6-4592-b705-5713910984e9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.474087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51954-75f6-4592-b705-5713910984e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.474365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51954-75f6-4592-b705-5713910984e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.475129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee51954-75f6-4592-b705-5713910984e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:58.475436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee51954-75f6-4592-b705-5713910984e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:58.476834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee51954-75f6-4592-b705-5713910984e9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:58.489174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 311/631] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:43:58.495062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51954-75f6-4592-b705-5713910984e9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.579223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fedf7b-e06e-411b-9d00-17efdb6def24 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:58.613231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2d91e-f1b3-44d0-be78-ca100ec6c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:58.613598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51954-75f6-4592-b705-5713910984e9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:58.614052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2d91e-f1b3-44d0-be78-ca100ec6c471 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.614326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2d91e-f1b3-44d0-be78-ca100ec6c471 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.614595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2d91e-f1b3-44d0-be78-ca100ec6c471 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.622250 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2d91e-f1b3-44d0-be78-ca100ec6c471 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:58.623699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2d91e-f1b3-44d0-be78-ca100ec6c471 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-17f2d91e-f1b3-44d0-be78-ca100ec6c471 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:58.638634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:58.640944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:58.642514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 321/632] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:58.645649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec512d6b-5a77-4af0-8aec-23d19bc92538 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.646028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec512d6b-5a77-4af0-8aec-23d19bc92538 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.646318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec512d6b-5a77-4af0-8aec-23d19bc92538 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.647974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 322/633] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:58.648811 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec512d6b-5a77-4af0-8aec-23d19bc92538 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.649363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc272d8-f667-4aab-b9b3-6340215728ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:58.650134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc272d8-f667-4aab-b9b3-6340215728ca None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.650411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc272d8-f667-4aab-b9b3-6340215728ca None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.650681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc272d8-f667-4aab-b9b3-6340215728ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.664273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc272d8-f667-4aab-b9b3-6340215728ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:58.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc272d8-f667-4aab-b9b3-6340215728ca None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-cdc272d8-f667-4aab-b9b3-6340215728ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:58.686732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:58.687683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:58.689695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:58.689695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:58.689695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:58.689695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:58.689695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 312/634] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:58.694056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489480-3b6c-44d6-9c1a-1d608413910d None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.694370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489480-3b6c-44d6-9c1a-1d608413910d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.694652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489480-3b6c-44d6-9c1a-1d608413910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.712106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3c489480-3b6c-44d6-9c1a-1d608413910d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:58.713299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3c489480-3b6c-44d6-9c1a-1d608413910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:58.766574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec512d6b-5a77-4af0-8aec-23d19bc92538 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:58.779475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 313/635] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:58.780422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489480-3b6c-44d6-9c1a-1d608413910d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.810740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d9de-72d1-461f-b708-b8ed530caab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:58.811470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d9de-72d1-461f-b708-b8ed530caab7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.811945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d9de-72d1-461f-b708-b8ed530caab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.812218 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d9de-72d1-461f-b708-b8ed530caab7 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.813067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d9de-72d1-461f-b708-b8ed530caab7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:58.814498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d9de-72d1-461f-b708-b8ed530caab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:58.816026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d9de-72d1-461f-b708-b8ed530caab7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:58.834072 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 323/636] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:58.839279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d9de-72d1-461f-b708-b8ed530caab7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.897147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489480-3b6c-44d6-9c1a-1d608413910d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:58.934567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573dff5-137f-46be-a0e2-8e73ae1f3909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:58.935246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573dff5-137f-46be-a0e2-8e73ae1f3909 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:58.935525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573dff5-137f-46be-a0e2-8e73ae1f3909 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:58.935791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573dff5-137f-46be-a0e2-8e73ae1f3909 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:58.936529 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573dff5-137f-46be-a0e2-8e73ae1f3909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:58.936836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573dff5-137f-46be-a0e2-8e73ae1f3909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:58.938246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573dff5-137f-46be-a0e2-8e73ae1f3909 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:58.954683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 314/637] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:58.955565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573dff5-137f-46be-a0e2-8e73ae1f3909 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:58.967803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d9de-72d1-461f-b708-b8ed530caab7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.010486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966ca8a-ee78-4ffa-a7ec-7d0cd5e7c369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.012040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966ca8a-ee78-4ffa-a7ec-7d0cd5e7c369 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.012771 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966ca8a-ee78-4ffa-a7ec-7d0cd5e7c369 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.013256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966ca8a-ee78-4ffa-a7ec-7d0cd5e7c369 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.026335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966ca8a-ee78-4ffa-a7ec-7d0cd5e7c369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-4966ca8a-ee78-4ffa-a7ec-7d0cd5e7c369 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:59.036321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:59.037314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:59.038212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:59.040729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 324/638] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:59.041761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966ca8a-ee78-4ffa-a7ec-7d0cd5e7c369 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.058421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573dff5-137f-46be-a0e2-8e73ae1f3909 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.092121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94431c-1dab-4afb-aa45-61996d10406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.092928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94431c-1dab-4afb-aa45-61996d10406c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.093128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94431c-1dab-4afb-aa45-61996d10406c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.093419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94431c-1dab-4afb-aa45-61996d10406c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.104172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94431c-1dab-4afb-aa45-61996d10406c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:59.105608 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94431c-1dab-4afb-aa45-61996d10406c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8e94431c-1dab-4afb-aa45-61996d10406c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:59.122399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:59.123379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:59.129578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:59.129578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:59.129578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:59.129578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:59.129578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 315/639] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:59.129578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94431c-1dab-4afb-aa45-61996d10406c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.143797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966ca8a-ee78-4ffa-a7ec-7d0cd5e7c369 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.175950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2903e-59e9-4a2b-b764-8c2855302f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.176748 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2903e-59e9-4a2b-b764-8c2855302f51 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.177029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2903e-59e9-4a2b-b764-8c2855302f51 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.177313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2903e-59e9-4a2b-b764-8c2855302f51 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.185248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2903e-59e9-4a2b-b764-8c2855302f51 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:59.186988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2903e-59e9-4a2b-b764-8c2855302f51 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-04e2903e-59e9-4a2b-b764-8c2855302f51 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:43:59.200866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:59.206775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 325/640] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7647ea-64be-49a1-982d-5988c837c19c None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.209635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7647ea-64be-49a1-982d-5988c837c19c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.211294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7647ea-64be-49a1-982d-5988c837c19c None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.211294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 326/641] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:43:59.211294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7647ea-64be-49a1-982d-5988c837c19c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.225396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94431c-1dab-4afb-aa45-61996d10406c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.258295 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf4b6b-1924-49a5-9b5e-98d9062f4db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.259028 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf4b6b-1924-49a5-9b5e-98d9062f4db5 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.259298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf4b6b-1924-49a5-9b5e-98d9062f4db5 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.259595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf4b6b-1924-49a5-9b5e-98d9062f4db5 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.260318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf4b6b-1924-49a5-9b5e-98d9062f4db5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:59.260621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf4b6b-1924-49a5-9b5e-98d9062f4db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:59.262002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf4b6b-1924-49a5-9b5e-98d9062f4db5 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:59.274461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 316/642] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:59.274461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfb0aa-9aec-4906-a916-e2f15e1c8cdd None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.274461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfb0aa-9aec-4906-a916-e2f15e1c8cdd None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.274461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfb0aa-9aec-4906-a916-e2f15e1c8cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.291381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-92dfb0aa-9aec-4906-a916-e2f15e1c8cdd None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:43:59.292549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-92dfb0aa-9aec-4906-a916-e2f15e1c8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:43:59.309079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7647ea-64be-49a1-982d-5988c837c19c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.341804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39f3b6-5df8-4aa9-99c5-a5a3e8e5323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.342518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39f3b6-5df8-4aa9-99c5-a5a3e8e5323c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.342750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39f3b6-5df8-4aa9-99c5-a5a3e8e5323c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.343019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39f3b6-5df8-4aa9-99c5-a5a3e8e5323c None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.343742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39f3b6-5df8-4aa9-99c5-a5a3e8e5323c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:59.344045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39f3b6-5df8-4aa9-99c5-a5a3e8e5323c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:59.345428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39f3b6-5df8-4aa9-99c5-a5a3e8e5323c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:59.365568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 317/643] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:43:59.365742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 327/644] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:59.365821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfb0aa-9aec-4906-a916-e2f15e1c8cdd None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.365891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39f3b6-5df8-4aa9-99c5-a5a3e8e5323c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.451425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfb0aa-9aec-4906-a916-e2f15e1c8cdd None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.469960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39f3b6-5df8-4aa9-99c5-a5a3e8e5323c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.484664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6234ea-a424-4416-b3e2-e1d4911a68c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.485365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6234ea-a424-4416-b3e2-e1d4911a68c6 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.485644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6234ea-a424-4416-b3e2-e1d4911a68c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.485908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6234ea-a424-4416-b3e2-e1d4911a68c6 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.486748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6234ea-a424-4416-b3e2-e1d4911a68c6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:59.487165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6234ea-a424-4416-b3e2-e1d4911a68c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:59.488491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6234ea-a424-4416-b3e2-e1d4911a68c6 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:59.503624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c5691-f874-4ae2-9df6-f135ed9b2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.504420 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c5691-f874-4ae2-9df6-f135ed9b2082 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.504700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c5691-f874-4ae2-9df6-f135ed9b2082 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.504973 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c5691-f874-4ae2-9df6-f135ed9b2082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.509877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 318/645] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:59.509877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6234ea-a424-4416-b3e2-e1d4911a68c6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.519923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c5691-f874-4ae2-9df6-f135ed9b2082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:59.521449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c5691-f874-4ae2-9df6-f135ed9b2082 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-0c0c5691-f874-4ae2-9df6-f135ed9b2082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:43:59.540132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:59.541139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:59.542163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:43:59.542163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:43:59.542163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:43:59.542163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:59.542163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 328/646] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:59.542163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c5691-f874-4ae2-9df6-f135ed9b2082 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.611147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6234ea-a424-4416-b3e2-e1d4911a68c6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.639293 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c5691-f874-4ae2-9df6-f135ed9b2082 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.643743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847a33-58f4-49fe-b30e-b443bbcd3fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.644574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847a33-58f4-49fe-b30e-b443bbcd3fd9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.644856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847a33-58f4-49fe-b30e-b443bbcd3fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.645129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847a33-58f4-49fe-b30e-b443bbcd3fd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.651594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12847a33-58f4-49fe-b30e-b443bbcd3fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:59.653062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12847a33-58f4-49fe-b30e-b443bbcd3fd9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-12847a33-58f4-49fe-b30e-b443bbcd3fd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:43:59.666586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:59.667515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:59.668419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:43:59.668419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:43:59.668419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:43:59.668419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:43:59.668419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:43:59.668419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:43:59.668419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:43:59.668419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:43:59.668419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 319/647] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:59.668947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847a33-58f4-49fe-b30e-b443bbcd3fd9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.676220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630581c1-35f6-425d-85d1-0ec10f365ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.677025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630581c1-35f6-425d-85d1-0ec10f365ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.677333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630581c1-35f6-425d-85d1-0ec10f365ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.677613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630581c1-35f6-425d-85d1-0ec10f365ae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.691098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630581c1-35f6-425d-85d1-0ec10f365ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-630581c1-35f6-425d-85d1-0ec10f365ae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:43:59.699464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:43:59.700401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:43:59.701380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 329/648] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:43:59.702113 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630581c1-35f6-425d-85d1-0ec10f365ae9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.767157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847a33-58f4-49fe-b30e-b443bbcd3fd9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.794108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630581c1-35f6-425d-85d1-0ec10f365ae9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.803349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb891d42-9445-409b-be55-69437bd1f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.804303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891d42-9445-409b-be55-69437bd1f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.804803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891d42-9445-409b-be55-69437bd1f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.805224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891d42-9445-409b-be55-69437bd1f9c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.829696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd379ce-a997-4771-b045-7873399db2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.830925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd379ce-a997-4771-b045-7873399db2f4 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.831213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd379ce-a997-4771-b045-7873399db2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.831517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd379ce-a997-4771-b045-7873399db2f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.832404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd379ce-a997-4771-b045-7873399db2f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:59.833007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd379ce-a997-4771-b045-7873399db2f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:59.834822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd379ce-a997-4771-b045-7873399db2f4 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:59.854194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 330/649] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:43:59.854194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd379ce-a997-4771-b045-7873399db2f4 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.869846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb891d42-9445-409b-be55-69437bd1f9c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:43:59.871214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb891d42-9445-409b-be55-69437bd1f9c6 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:43:59.954726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd379ce-a997-4771-b045-7873399db2f4 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:43:59.972174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 320/650] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:43:59.972174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb891d42-9445-409b-be55-69437bd1f9c6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:43:59.995086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc968881-6518-4075-b901-15de44680fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:43:59.996009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc968881-6518-4075-b901-15de44680fbc None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:43:59.996445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc968881-6518-4075-b901-15de44680fbc None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:43:59.996863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc968881-6518-4075-b901-15de44680fbc None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:43:59.997828 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc968881-6518-4075-b901-15de44680fbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:43:59.998282 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc968881-6518-4075-b901-15de44680fbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.000207 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc968881-6518-4075-b901-15de44680fbc None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.011424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 331/651] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:00.012228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc968881-6518-4075-b901-15de44680fbc None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.071560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb891d42-9445-409b-be55-69437bd1f9c6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.109738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbabe1-50e6-44c4-8668-8020c4ec3f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.110416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbabe1-50e6-44c4-8668-8020c4ec3f7e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.110695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbabe1-50e6-44c4-8668-8020c4ec3f7e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.110969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbabe1-50e6-44c4-8668-8020c4ec3f7e None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.111722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbabe1-50e6-44c4-8668-8020c4ec3f7e None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:00.112029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbabe1-50e6-44c4-8668-8020c4ec3f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.113048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc968881-6518-4075-b901-15de44680fbc None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.113472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbabe1-50e6-44c4-8668-8020c4ec3f7e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.126404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 321/652] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:43:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:00.126404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbabe1-50e6-44c4-8668-8020c4ec3f7e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.150824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176154ca-da17-4db5-acfa-1f58e5912da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.151627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176154ca-da17-4db5-acfa-1f58e5912da5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.151921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176154ca-da17-4db5-acfa-1f58e5912da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.152165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176154ca-da17-4db5-acfa-1f58e5912da5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.159494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176154ca-da17-4db5-acfa-1f58e5912da5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.160959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176154ca-da17-4db5-acfa-1f58e5912da5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-176154ca-da17-4db5-acfa-1f58e5912da5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:00.174470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:00.175653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 332/653] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:00.176658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176154ca-da17-4db5-acfa-1f58e5912da5 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.223441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbabe1-50e6-44c4-8668-8020c4ec3f7e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.255561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979376a0-43bf-430d-9eba-c5f3e9049410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.256381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979376a0-43bf-430d-9eba-c5f3e9049410 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.256654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979376a0-43bf-430d-9eba-c5f3e9049410 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.256936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979376a0-43bf-430d-9eba-c5f3e9049410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.267336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979376a0-43bf-430d-9eba-c5f3e9049410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.268777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979376a0-43bf-430d-9eba-c5f3e9049410 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.274216 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176154ca-da17-4db5-acfa-1f58e5912da5 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-979376a0-43bf-430d-9eba-c5f3e9049410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:00.286025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:00.286943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:00.287837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:00.287837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:00.287837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:00.287837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:00.287837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 322/654] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:00.288559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979376a0-43bf-430d-9eba-c5f3e9049410 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.308854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2739d-1dc3-4137-949c-8635bfbc2446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.309807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2739d-1dc3-4137-949c-8635bfbc2446 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.310087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2739d-1dc3-4137-949c-8635bfbc2446 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.310356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2739d-1dc3-4137-949c-8635bfbc2446 None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/d94a895e3a3547ff9cf35d808c595071/roles/b2763aed3ee84a9a9c5186ecada8844f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.324380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2739d-1dc3-4137-949c-8635bfbc2446 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=d94a895e3a3547ff9cf35d808c595071, role_id=b2763aed3ee84a9a9c5186ecada8844f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.325893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2739d-1dc3-4137-949c-8635bfbc2446 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.339952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 333/655] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:44:00 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/d94a895e3a3547ff9cf35d808c595071/roles/b2763aed3ee84a9a9c5186ecada8844f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:44:00.341133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2739d-1dc3-4137-949c-8635bfbc2446 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.390800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979376a0-43bf-430d-9eba-c5f3e9049410 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.423735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bf2ac-53a5-430c-9cb4-7be9ba1fcb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.424562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bf2ac-53a5-430c-9cb4-7be9ba1fcb93 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.424848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bf2ac-53a5-430c-9cb4-7be9ba1fcb93 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.425147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bf2ac-53a5-430c-9cb4-7be9ba1fcb93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.436620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bf2ac-53a5-430c-9cb4-7be9ba1fcb93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.438136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bf2ac-53a5-430c-9cb4-7be9ba1fcb93 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-469bf2ac-53a5-430c-9cb4-7be9ba1fcb93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:00.459305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:00.460697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:00.461657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:00.461657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:00.461657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:00.461657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:00.465530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 323/656] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:00.466547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bf2ac-53a5-430c-9cb4-7be9ba1fcb93 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.479523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2739d-1dc3-4137-949c-8635bfbc2446 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.515918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6f260-a665-4297-ab13-8c7678d9c412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.517157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6f260-a665-4297-ab13-8c7678d9c412 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.517658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6f260-a665-4297-ab13-8c7678d9c412 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.518171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6f260-a665-4297-ab13-8c7678d9c412 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.519336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6f260-a665-4297-ab13-8c7678d9c412 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:00.519969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6f260-a665-4297-ab13-8c7678d9c412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.521670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6f260-a665-4297-ab13-8c7678d9c412 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.547558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 334/657] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:00.549308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6f260-a665-4297-ab13-8c7678d9c412 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.586982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bf2ac-53a5-430c-9cb4-7be9ba1fcb93 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.630120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64181aa9-69b1-4095-b8da-2a777ad4aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.630786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64181aa9-69b1-4095-b8da-2a777ad4aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.631064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64181aa9-69b1-4095-b8da-2a777ad4aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.631332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64181aa9-69b1-4095-b8da-2a777ad4aeb7 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.632119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64181aa9-69b1-4095-b8da-2a777ad4aeb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:00.632443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64181aa9-69b1-4095-b8da-2a777ad4aeb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.633863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64181aa9-69b1-4095-b8da-2a777ad4aeb7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.645996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 324/658] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:00.646749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64181aa9-69b1-4095-b8da-2a777ad4aeb7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.676516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6f260-a665-4297-ab13-8c7678d9c412 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.711513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d5330-84a8-428a-9ba4-7e93025e4ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.712178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d5330-84a8-428a-9ba4-7e93025e4ab8 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.712460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d5330-84a8-428a-9ba4-7e93025e4ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.712738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d5330-84a8-428a-9ba4-7e93025e4ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.713487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d5330-84a8-428a-9ba4-7e93025e4ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:00.713794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d5330-84a8-428a-9ba4-7e93025e4ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.715233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d5330-84a8-428a-9ba4-7e93025e4ab8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.729455 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 335/659] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:00.730723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d5330-84a8-428a-9ba4-7e93025e4ab8 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.748194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64181aa9-69b1-4095-b8da-2a777ad4aeb7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.781725 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565867ea-98ed-42b0-b384-3dc58783cfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.782381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565867ea-98ed-42b0-b384-3dc58783cfa3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.782726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565867ea-98ed-42b0-b384-3dc58783cfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.782935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565867ea-98ed-42b0-b384-3dc58783cfa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.825494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d5330-84a8-428a-9ba4-7e93025e4ab8 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:00.848520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565867ea-98ed-42b0-b384-3dc58783cfa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.849996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565867ea-98ed-42b0-b384-3dc58783cfa3 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.857413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b0c7b-c613-4232-b203-81ebbb552d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:00.858204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b0c7b-c613-4232-b203-81ebbb552d4f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.858480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b0c7b-c613-4232-b203-81ebbb552d4f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.858807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b0c7b-c613-4232-b203-81ebbb552d4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.865468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b0c7b-c613-4232-b203-81ebbb552d4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:00.867051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b0c7b-c613-4232-b203-81ebbb552d4f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-d36b0c7b-c613-4232-b203-81ebbb552d4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:00.880939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:00.881867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:00.882755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:00.882755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:00.882755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:00.882755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:00.882755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:00.882755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:00.882755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:00.882755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:00.882755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 336/660] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:00.883749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9302dd-f5d2-4523-bde0-255c56c5bfa4 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:00.883749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9302dd-f5d2-4523-bde0-255c56c5bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:00.883917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9302dd-f5d2-4523-bde0-255c56c5bfa4 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:00.885183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 337/661] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:00.889444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9302dd-f5d2-4523-bde0-255c56c5bfa4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.959082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 325/662] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:44:00.959082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565867ea-98ed-42b0-b384-3dc58783cfa3 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:00.986202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9302dd-f5d2-4523-bde0-255c56c5bfa4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:01.029243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03b322-3e20-455c-b14d-12f01c725501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:01.030167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03b322-3e20-455c-b14d-12f01c725501 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.030532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03b322-3e20-455c-b14d-12f01c725501 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.030868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03b322-3e20-455c-b14d-12f01c725501 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.038242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03b322-3e20-455c-b14d-12f01c725501 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:01.039734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03b322-3e20-455c-b14d-12f01c725501 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-fb03b322-3e20-455c-b14d-12f01c725501 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:01.066031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:01.067076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:01.068005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 338/663] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:01.068600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89188c10-1f61-4b21-aa23-4ff18b0dbb91 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.068677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89188c10-1f61-4b21-aa23-4ff18b0dbb91 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.069454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89188c10-1f61-4b21-aa23-4ff18b0dbb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.079365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565867ea-98ed-42b0-b384-3dc58783cfa3 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:01.088063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-89188c10-1f61-4b21-aa23-4ff18b0dbb91 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:01.093394 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-89188c10-1f61-4b21-aa23-4ff18b0dbb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:01.121219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9262a-1e50-4778-b516-dc73f7429439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:01.121923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9262a-1e50-4778-b516-dc73f7429439 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.122252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9262a-1e50-4778-b516-dc73f7429439 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.123144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9262a-1e50-4778-b516-dc73f7429439 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.124154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9262a-1e50-4778-b516-dc73f7429439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:01.124910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9262a-1e50-4778-b516-dc73f7429439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:01.126821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9262a-1e50-4778-b516-dc73f7429439 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:01.145455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 326/664] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:01.146314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9262a-1e50-4778-b516-dc73f7429439 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:01.197361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 339/665] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:44:01.197361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89188c10-1f61-4b21-aa23-4ff18b0dbb91 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:01.252830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9262a-1e50-4778-b516-dc73f7429439 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:01.294102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ba25-dad3-4afe-a4b6-bfa95dc59185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:01.295277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ba25-dad3-4afe-a4b6-bfa95dc59185 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.295781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ba25-dad3-4afe-a4b6-bfa95dc59185 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.296250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ba25-dad3-4afe-a4b6-bfa95dc59185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.308068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75ba25-dad3-4afe-a4b6-bfa95dc59185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:01.309599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75ba25-dad3-4afe-a4b6-bfa95dc59185 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:01.311116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89188c10-1f61-4b21-aa23-4ff18b0dbb91 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-7c75ba25-dad3-4afe-a4b6-bfa95dc59185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:01.327044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:01.327971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:01.328858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:01.328858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:01.328858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:01.328858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:01.332881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 327/666] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:01.333759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ba25-dad3-4afe-a4b6-bfa95dc59185 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:01.349335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc7a8-158f-4337-a2a5-78a047884679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:01.350363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc7a8-158f-4337-a2a5-78a047884679 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.350875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc7a8-158f-4337-a2a5-78a047884679 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.351343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc7a8-158f-4337-a2a5-78a047884679 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.352378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dc7a8-158f-4337-a2a5-78a047884679 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:01.353019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dc7a8-158f-4337-a2a5-78a047884679 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:01.354806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dc7a8-158f-4337-a2a5-78a047884679 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:01.374037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 340/667] 10.222.0.35 () {56 vars in 1139 bytes} [Wed May 4 18:44:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:01.375676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc7a8-158f-4337-a2a5-78a047884679 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:01.436674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ba25-dad3-4afe-a4b6-bfa95dc59185 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:01.470488 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c0736-39b7-454d-9933-ba1ca18e11f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:01.471161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0736-39b7-454d-9933-ba1ca18e11f4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.471433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0736-39b7-454d-9933-ba1ca18e11f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.471706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0736-39b7-454d-9933-ba1ca18e11f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.472583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c0736-39b7-454d-9933-ba1ca18e11f4 None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=432759ff503942e7ae6941f9d4b951b4) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:01.472895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c0736-39b7-454d-9933-ba1ca18e11f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:01.474355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c0736-39b7-454d-9933-ba1ca18e11f4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:01.480078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 328/668] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:01 2022] GET /identity/v3/role_assignments?user.id=432759ff503942e7ae6941f9d4b951b4&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:01.480843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c0736-39b7-454d-9933-ba1ca18e11f4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:01.482082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc7a8-158f-4337-a2a5-78a047884679 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:01.529039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cbc28-06c6-4d39-a911-5e83427bf5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:01.530178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cbc28-06c6-4d39-a911-5e83427bf5aa None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.530637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cbc28-06c6-4d39-a911-5e83427bf5aa None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.531142 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cbc28-06c6-4d39-a911-5e83427bf5aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.543124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cbc28-06c6-4d39-a911-5e83427bf5aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-f93cbc28-06c6-4d39-a911-5e83427bf5aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:01.551613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:01.552678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:01.553678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:01.556286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 341/669] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:01.557415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cbc28-06c6-4d39-a911-5e83427bf5aa None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:01.628515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c0736-39b7-454d-9933-ba1ca18e11f4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:01.664902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cbc28-06c6-4d39-a911-5e83427bf5aa None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:01.675930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d5d21-4d78-4c76-8a38-c2e71a7295a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:01.676452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d5d21-4d78-4c76-8a38-c2e71a7295a4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.676750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d5d21-4d78-4c76-8a38-c2e71a7295a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.677031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d5d21-4d78-4c76-8a38-c2e71a7295a4 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.678103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d5d21-4d78-4c76-8a38-c2e71a7295a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:01.678416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d5d21-4d78-4c76-8a38-c2e71a7295a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:01.680313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d5d21-4d78-4c76-8a38-c2e71a7295a4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:01.695724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 329/670] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:01.696826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d5d21-4d78-4c76-8a38-c2e71a7295a4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:01.703150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf1d57-7bfb-4714-899d-16338b5fd802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:01.704089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1d57-7bfb-4714-899d-16338b5fd802 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.704580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1d57-7bfb-4714-899d-16338b5fd802 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.705054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1d57-7bfb-4714-899d-16338b5fd802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.790896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf1d57-7bfb-4714-899d-16338b5fd802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:01.792851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf1d57-7bfb-4714-899d-16338b5fd802 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:01.803596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d5d21-4d78-4c76-8a38-c2e71a7295a4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:01.837353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ae5a-2347-45dd-a737-6dee561d1cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:01.838029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ae5a-2347-45dd-a737-6dee561d1cad None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:01.838308 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ae5a-2347-45dd-a737-6dee561d1cad None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:01.838581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2ae5a-2347-45dd-a737-6dee561d1cad None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:01.839334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ae5a-2347-45dd-a737-6dee561d1cad None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:01.839641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ae5a-2347-45dd-a737-6dee561d1cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:01.841073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2ae5a-2347-45dd-a737-6dee561d1cad None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:01.853765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 330/671] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:01.854567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ae5a-2347-45dd-a737-6dee561d1cad None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:01.913823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 342/672] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:44:01.913823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf1d57-7bfb-4714-899d-16338b5fd802 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:01.969370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2ae5a-2347-45dd-a737-6dee561d1cad None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.008077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51612b06-9436-4050-bff3-f745cb6bb602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.009498 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51612b06-9436-4050-bff3-f745cb6bb602 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.010007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51612b06-9436-4050-bff3-f745cb6bb602 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.010495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51612b06-9436-4050-bff3-f745cb6bb602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.016660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf1d57-7bfb-4714-899d-16338b5fd802 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.018218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51612b06-9436-4050-bff3-f745cb6bb602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.019905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51612b06-9436-4050-bff3-f745cb6bb602 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-51612b06-9436-4050-bff3-f745cb6bb602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:02.034084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:02.035078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:02.035969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:02.035969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:02.035969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:02.035969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:02.035969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:02.035969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:02.035969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:02.035969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:02.038493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 331/673] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:02.039466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51612b06-9436-4050-bff3-f745cb6bb602 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.053892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72931ab7-a99b-4238-a9d5-91fc997bf668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.054631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72931ab7-a99b-4238-a9d5-91fc997bf668 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.054912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72931ab7-a99b-4238-a9d5-91fc997bf668 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.055525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72931ab7-a99b-4238-a9d5-91fc997bf668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.067532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72931ab7-a99b-4238-a9d5-91fc997bf668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.069324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72931ab7-a99b-4238-a9d5-91fc997bf668 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-72931ab7-a99b-4238-a9d5-91fc997bf668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:02.092639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:02.093897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:02.094815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:02.094815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:02.094815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:02.094815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:02.098554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 343/674] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:02.099403 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72931ab7-a99b-4238-a9d5-91fc997bf668 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.147761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51612b06-9436-4050-bff3-f745cb6bb602 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.181568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1b1ee-e35f-4393-8afc-4834d377840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.182739 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1b1ee-e35f-4393-8afc-4834d377840f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.183217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1b1ee-e35f-4393-8afc-4834d377840f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.183686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1b1ee-e35f-4393-8afc-4834d377840f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.193933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1b1ee-e35f-4393-8afc-4834d377840f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.195656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1b1ee-e35f-4393-8afc-4834d377840f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.196955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72931ab7-a99b-4238-a9d5-91fc997bf668 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-aad1b1ee-e35f-4393-8afc-4834d377840f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:02.213851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:02.214798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:02.215698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:02.215698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:02.215698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:02.215698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:02.217976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 332/675] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:02.218955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1b1ee-e35f-4393-8afc-4834d377840f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.236556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a18aab-e2e5-4897-9595-33c854300079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.237275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a18aab-e2e5-4897-9595-33c854300079 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.237535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a18aab-e2e5-4897-9595-33c854300079 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.237884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a18aab-e2e5-4897-9595-33c854300079 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.238850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a18aab-e2e5-4897-9595-33c854300079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:02.239164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a18aab-e2e5-4897-9595-33c854300079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.240890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a18aab-e2e5-4897-9595-33c854300079 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.257298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 344/676] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:02.258262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a18aab-e2e5-4897-9595-33c854300079 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.320838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1b1ee-e35f-4393-8afc-4834d377840f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.353973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2e284-eb23-4cb0-9bed-a442e008ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.354959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e284-eb23-4cb0-9bed-a442e008ee24 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.354959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e284-eb23-4cb0-9bed-a442e008ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.355222 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e284-eb23-4cb0-9bed-a442e008ee24 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.355935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2e284-eb23-4cb0-9bed-a442e008ee24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:02.356245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2e284-eb23-4cb0-9bed-a442e008ee24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.357641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2e284-eb23-4cb0-9bed-a442e008ee24 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.373325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 333/677] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:02.374209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2e284-eb23-4cb0-9bed-a442e008ee24 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.381973 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a18aab-e2e5-4897-9595-33c854300079 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.416634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f238b15-6871-42eb-bfa0-df0598942d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.417835 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238b15-6871-42eb-bfa0-df0598942d39 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.418338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238b15-6871-42eb-bfa0-df0598942d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.418832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238b15-6871-42eb-bfa0-df0598942d39 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.419831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f238b15-6871-42eb-bfa0-df0598942d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:02.420365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f238b15-6871-42eb-bfa0-df0598942d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.421991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f238b15-6871-42eb-bfa0-df0598942d39 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.440001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 345/678] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:02.441225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f238b15-6871-42eb-bfa0-df0598942d39 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.503735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2e284-eb23-4cb0-9bed-a442e008ee24 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.549925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19ed1-06df-465f-824c-6fc7edb7262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.550677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19ed1-06df-465f-824c-6fc7edb7262a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.550960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19ed1-06df-465f-824c-6fc7edb7262a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.551236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19ed1-06df-465f-824c-6fc7edb7262a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.552353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19ed1-06df-465f-824c-6fc7edb7262a None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=63b338ae7e374ba5a7542c5a53deb416) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:02.552670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19ed1-06df-465f-824c-6fc7edb7262a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.554684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19ed1-06df-465f-824c-6fc7edb7262a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.556886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f238b15-6871-42eb-bfa0-df0598942d39 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.562305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 334/679] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/role_assignments?user.id=63b338ae7e374ba5a7542c5a53deb416&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:02.563246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19ed1-06df-465f-824c-6fc7edb7262a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.598814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fbd3f-b7e2-4988-a4e8-c1c693b6f8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.599831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fbd3f-b7e2-4988-a4e8-c1c693b6f8fd None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.600114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fbd3f-b7e2-4988-a4e8-c1c693b6f8fd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.600389 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fbd3f-b7e2-4988-a4e8-c1c693b6f8fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.610204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fbd3f-b7e2-4988-a4e8-c1c693b6f8fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.612344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fbd3f-b7e2-4988-a4e8-c1c693b6f8fd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-f18fbd3f-b7e2-4988-a4e8-c1c693b6f8fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:02.632048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:02.633209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:02.634929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 346/680] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:02.639093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fbd3f-b7e2-4988-a4e8-c1c693b6f8fd None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.681018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19ed1-06df-465f-824c-6fc7edb7262a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.727753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24a1b8-5cc8-486f-b95e-9d427176265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.728999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24a1b8-5cc8-486f-b95e-9d427176265a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.729555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24a1b8-5cc8-486f-b95e-9d427176265a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.730037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24a1b8-5cc8-486f-b95e-9d427176265a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.747496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24a1b8-5cc8-486f-b95e-9d427176265a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.749927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24a1b8-5cc8-486f-b95e-9d427176265a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-0c24a1b8-5cc8-486f-b95e-9d427176265a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:02.771870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:02.772848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:02.773764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:02.773764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:02.773764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:02.773764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:02.773764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:02.773764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:02.773764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:02.773764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:02.781415 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 335/681] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:02.783574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24a1b8-5cc8-486f-b95e-9d427176265a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.792298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fbd3f-b7e2-4988-a4e8-c1c693b6f8fd None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.840716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed30688-df9d-4d94-bb2c-151404b305a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.842305 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed30688-df9d-4d94-bb2c-151404b305a2 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.843034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed30688-df9d-4d94-bb2c-151404b305a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.843649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed30688-df9d-4d94-bb2c-151404b305a2 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.846718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed30688-df9d-4d94-bb2c-151404b305a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:02.846718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed30688-df9d-4d94-bb2c-151404b305a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.847069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed30688-df9d-4d94-bb2c-151404b305a2 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.867613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 347/682] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:02.872790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e50e-5428-48fc-947a-71ef78f6963a None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.872790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e50e-5428-48fc-947a-71ef78f6963a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.872790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e50e-5428-48fc-947a-71ef78f6963a None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.872790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 348/683] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:02.875681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02e50e-5428-48fc-947a-71ef78f6963a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:02.901753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24a1b8-5cc8-486f-b95e-9d427176265a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:02.942029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee2ac-93f9-455d-9720-e78148011fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:02.942029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee2ac-93f9-455d-9720-e78148011fd1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.942416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee2ac-93f9-455d-9720-e78148011fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.942640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee2ac-93f9-455d-9720-e78148011fd1 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.943872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee2ac-93f9-455d-9720-e78148011fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:02.943872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee2ac-93f9-455d-9720-e78148011fd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:02.945808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee2ac-93f9-455d-9720-e78148011fd1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:02.962763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 336/684] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:02.967664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ac423-b611-4b1e-8153-3805d8d306d0 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:02.967664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ac423-b611-4b1e-8153-3805d8d306d0 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:02.967664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ac423-b611-4b1e-8153-3805d8d306d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:02.982761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a10ac423-b611-4b1e-8153-3805d8d306d0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:02.984015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a10ac423-b611-4b1e-8153-3805d8d306d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:02.986772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02e50e-5428-48fc-947a-71ef78f6963a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:03.027283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7135-3f14-4706-ba5a-185d46372514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:03.028287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7135-3f14-4706-ba5a-185d46372514 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:03.028567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7135-3f14-4706-ba5a-185d46372514 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:03.028840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7135-3f14-4706-ba5a-185d46372514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:03.052470 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 337/685] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:44:03.053415 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ac423-b611-4b1e-8153-3805d8d306d0 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:03.124786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e7135-3f14-4706-ba5a-185d46372514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:03.126194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e7135-3f14-4706-ba5a-185d46372514 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:03.166956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ac423-b611-4b1e-8153-3805d8d306d0 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:03.200960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a57bfa-bf83-4201-8b29-869104b5424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:03.201655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a57bfa-bf83-4201-8b29-869104b5424e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:03.201965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a57bfa-bf83-4201-8b29-869104b5424e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:03.202264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a57bfa-bf83-4201-8b29-869104b5424e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:03.203121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a57bfa-bf83-4201-8b29-869104b5424e None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=94b338c27d664f51bc9de29c9c6ba40e) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:03.203449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a57bfa-bf83-4201-8b29-869104b5424e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:03.204956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a57bfa-bf83-4201-8b29-869104b5424e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:03.211641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 338/686] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:03 2022] GET /identity/v3/role_assignments?user.id=94b338c27d664f51bc9de29c9c6ba40e&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:03.212505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a57bfa-bf83-4201-8b29-869104b5424e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:03.228416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 349/687] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 18:44:03.237837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7135-3f14-4706-ba5a-185d46372514 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:03.339445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7135-3f14-4706-ba5a-185d46372514 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:03.374988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1424d6-8c22-4eb5-9253-1c03fbf7f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:03.376098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1424d6-8c22-4eb5-9253-1c03fbf7f01f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:03.376427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a57bfa-bf83-4201-8b29-869104b5424e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:03.376784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1424d6-8c22-4eb5-9253-1c03fbf7f01f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:03.377236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1424d6-8c22-4eb5-9253-1c03fbf7f01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:03.402771 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1424d6-8c22-4eb5-9253-1c03fbf7f01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:03.404580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1424d6-8c22-4eb5-9253-1c03fbf7f01f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-9f1424d6-8c22-4eb5-9253-1c03fbf7f01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:03.423585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:03.424636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:03.425709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:03.425709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:03.425709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:03.425709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:03.427784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 350/688] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:03.438369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1424d6-8c22-4eb5-9253-1c03fbf7f01f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:03.453334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279566d-32f1-4e99-a22b-0bf5c3c103f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:03.453334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279566d-32f1-4e99-a22b-0bf5c3c103f0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:03.453655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279566d-32f1-4e99-a22b-0bf5c3c103f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:03.453896 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279566d-32f1-4e99-a22b-0bf5c3c103f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:03.479971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279566d-32f1-4e99-a22b-0bf5c3c103f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-0279566d-32f1-4e99-a22b-0bf5c3c103f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:03.494799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:03.495828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:03.496768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 339/689] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:44:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:03.505053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279566d-32f1-4e99-a22b-0bf5c3c103f0 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:03.595062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1424d6-8c22-4eb5-9253-1c03fbf7f01f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:03.621402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279566d-32f1-4e99-a22b-0bf5c3c103f0 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:03.639429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771052b-4bba-4ed8-aeb6-2b6c1357190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:03.640030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771052b-4bba-4ed8-aeb6-2b6c1357190b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:03.640311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771052b-4bba-4ed8-aeb6-2b6c1357190b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:03.640583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771052b-4bba-4ed8-aeb6-2b6c1357190b None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:03.641339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771052b-4bba-4ed8-aeb6-2b6c1357190b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:03.642053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771052b-4bba-4ed8-aeb6-2b6c1357190b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:03.643704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771052b-4bba-4ed8-aeb6-2b6c1357190b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:03.656392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c56872-a887-41d7-8016-08e13f1f7dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:03.657069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c56872-a887-41d7-8016-08e13f1f7dd9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:03.657394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c56872-a887-41d7-8016-08e13f1f7dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:03.657676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c56872-a887-41d7-8016-08e13f1f7dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:03.659151 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c56872-a887-41d7-8016-08e13f1f7dd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:03.659508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c56872-a887-41d7-8016-08e13f1f7dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:03.660941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c56872-a887-41d7-8016-08e13f1f7dd9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:03.661655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 351/690] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:03.663084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771052b-4bba-4ed8-aeb6-2b6c1357190b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:03.674911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 340/691] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:44:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:03.676384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c56872-a887-41d7-8016-08e13f1f7dd9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:03.777624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771052b-4bba-4ed8-aeb6-2b6c1357190b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:03.800360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c56872-a887-41d7-8016-08e13f1f7dd9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:03.810829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2805-9c0e-4bfc-8c63-3c7e6bce5fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:03.811583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2805-9c0e-4bfc-8c63-3c7e6bce5fed None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:03.811865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2805-9c0e-4bfc-8c63-3c7e6bce5fed None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:03.812134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2805-9c0e-4bfc-8c63-3c7e6bce5fed None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:03.819995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d2805-9c0e-4bfc-8c63-3c7e6bce5fed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:03.821486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d2805-9c0e-4bfc-8c63-3c7e6bce5fed None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:03.838179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabdf2-fced-489b-9732-4100a20f8e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:03.839072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabdf2-fced-489b-9732-4100a20f8e79 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:03.839358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabdf2-fced-489b-9732-4100a20f8e79 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:03.839631 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabdf2-fced-489b-9732-4100a20f8e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-ba0d2805-9c0e-4bfc-8c63-3c7e6bce5fed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:03.840515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:03.842502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:03.844132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:03.844132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:03.844132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:03.844132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:03.844132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:03.844132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:03.844132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:03.844132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:03.844132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 352/692] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:03.848684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2805-9c0e-4bfc-8c63-3c7e6bce5fed None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:03.861762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fabdf2-fced-489b-9732-4100a20f8e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:03.863481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fabdf2-fced-489b-9732-4100a20f8e79 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-a5fabdf2-fced-489b-9732-4100a20f8e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:03.884722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:03.886832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:03.888925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:03.888925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:03.888925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:03.888925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:03.888925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 341/693] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:03.888925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9598f-035e-4645-881f-aa45e2a81b25 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:03.888925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9598f-035e-4645-881f-aa45e2a81b25 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:03.888925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9598f-035e-4645-881f-aa45e2a81b25 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:03.890039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 342/694] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:03.894310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9598f-035e-4645-881f-aa45e2a81b25 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:03.966681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2805-9c0e-4bfc-8c63-3c7e6bce5fed None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:04.001762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bad5b4-ed72-4741-b7d0-271ef29a3dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:04.002137 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9598f-035e-4645-881f-aa45e2a81b25 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:04.002422 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bad5b4-ed72-4741-b7d0-271ef29a3dae None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.002698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bad5b4-ed72-4741-b7d0-271ef29a3dae None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.002968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bad5b4-ed72-4741-b7d0-271ef29a3dae None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.003894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bad5b4-ed72-4741-b7d0-271ef29a3dae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:04.004195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bad5b4-ed72-4741-b7d0-271ef29a3dae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:04.005649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bad5b4-ed72-4741-b7d0-271ef29a3dae None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:04.022282 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 353/695] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:04.023509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a94030-970a-4d63-81b5-5e8c2f8cf41b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.023791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a94030-970a-4d63-81b5-5e8c2f8cf41b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.024064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a94030-970a-4d63-81b5-5e8c2f8cf41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.039986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c8ff-c576-4ec5-baf4-c0fa3a0324ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:04.040345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-60a94030-970a-4d63-81b5-5e8c2f8cf41b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:04.040705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c8ff-c576-4ec5-baf4-c0fa3a0324ef None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.041043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c8ff-c576-4ec5-baf4-c0fa3a0324ef None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.041347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c8ff-c576-4ec5-baf4-c0fa3a0324ef None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.041528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-60a94030-970a-4d63-81b5-5e8c2f8cf41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:04.042130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436c8ff-c576-4ec5-baf4-c0fa3a0324ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:04.042445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436c8ff-c576-4ec5-baf4-c0fa3a0324ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:04.044011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436c8ff-c576-4ec5-baf4-c0fa3a0324ef None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:04.060886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 343/696] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:04.061787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c8ff-c576-4ec5-baf4-c0fa3a0324ef None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:04.121412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 354/697] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:44:04.122300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a94030-970a-4d63-81b5-5e8c2f8cf41b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:04.164740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c8ff-c576-4ec5-baf4-c0fa3a0324ef None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:04.199281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77063af6-45a7-4acb-b9a2-c4aae0c19619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:04.199943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77063af6-45a7-4acb-b9a2-c4aae0c19619 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.200220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77063af6-45a7-4acb-b9a2-c4aae0c19619 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.200495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77063af6-45a7-4acb-b9a2-c4aae0c19619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.201349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77063af6-45a7-4acb-b9a2-c4aae0c19619 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=3938216005694c45bd6126415930d014) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:04.201668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77063af6-45a7-4acb-b9a2-c4aae0c19619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:04.203088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77063af6-45a7-4acb-b9a2-c4aae0c19619 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:04.208945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 344/698] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:04 2022] GET /identity/v3/role_assignments?user.id=3938216005694c45bd6126415930d014&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:04.209749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77063af6-45a7-4acb-b9a2-c4aae0c19619 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:04.247470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a94030-970a-4d63-81b5-5e8c2f8cf41b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:04.316432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77063af6-45a7-4acb-b9a2-c4aae0c19619 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:04.318118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9821-27b2-44de-b330-14a930169238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:04.318939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9821-27b2-44de-b330-14a930169238 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.319215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9821-27b2-44de-b330-14a930169238 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.319486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9821-27b2-44de-b330-14a930169238 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.327210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b9821-27b2-44de-b330-14a930169238 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:04.328665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b9821-27b2-44de-b330-14a930169238 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:04.352395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7daa33-75d4-431a-a3b6-5997c16989d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:04.353234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7daa33-75d4-431a-a3b6-5997c16989d5 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.353604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7daa33-75d4-431a-a3b6-5997c16989d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.353883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7daa33-75d4-431a-a3b6-5997c16989d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.354610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7daa33-75d4-431a-a3b6-5997c16989d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:04.356033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7daa33-75d4-431a-a3b6-5997c16989d5 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-f83b9821-27b2-44de-b330-14a930169238 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:04.360488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:04.362716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:04.365039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 355/699] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:04.369350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9821-27b2-44de-b330-14a930169238 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-dc7daa33-75d4-431a-a3b6-5997c16989d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:04.371571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:04.373785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:04.376081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 345/700] 10.222.0.35 () {56 vars in 1129 bytes} [Wed May 4 18:44:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:04.394506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7daa33-75d4-431a-a3b6-5997c16989d5 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:04.478103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9821-27b2-44de-b330-14a930169238 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:04.513252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc72079-1d76-4639-86bc-2de77b00118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:04.513962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc72079-1d76-4639-86bc-2de77b00118f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.514237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc72079-1d76-4639-86bc-2de77b00118f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.514502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc72079-1d76-4639-86bc-2de77b00118f None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.515356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc72079-1d76-4639-86bc-2de77b00118f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:04.515659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc72079-1d76-4639-86bc-2de77b00118f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:04.517106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc72079-1d76-4639-86bc-2de77b00118f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:04.536442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 356/701] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 4 18:44:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:04.542935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc72079-1d76-4639-86bc-2de77b00118f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:04.583380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7daa33-75d4-431a-a3b6-5997c16989d5 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:04.654990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9025-a4dc-4383-b59d-819448e04302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:04.655689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9025-a4dc-4383-b59d-819448e04302 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.655967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9025-a4dc-4383-b59d-819448e04302 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.656243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9025-a4dc-4383-b59d-819448e04302 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.656978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9025-a4dc-4383-b59d-819448e04302 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:04.657297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9025-a4dc-4383-b59d-819448e04302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:04.658721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9025-a4dc-4383-b59d-819448e04302 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:04.661020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc72079-1d76-4639-86bc-2de77b00118f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:04.673554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 346/702] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 4 18:44:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:04.689255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9025-a4dc-4383-b59d-819448e04302 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:04.699240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310197a-16c9-4c5c-9ca5-e3766059b591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:04.699895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310197a-16c9-4c5c-9ca5-e3766059b591 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.700175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310197a-16c9-4c5c-9ca5-e3766059b591 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.700442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310197a-16c9-4c5c-9ca5-e3766059b591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.766369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310197a-16c9-4c5c-9ca5-e3766059b591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:04.767763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310197a-16c9-4c5c-9ca5-e3766059b591 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:04.863347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 357/703] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 18:44:04.874729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310197a-16c9-4c5c-9ca5-e3766059b591 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:04.884633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9025-a4dc-4383-b59d-819448e04302 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:04.920807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f2e9a-aded-4f70-af27-6b6567696d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:04.923054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f2e9a-aded-4f70-af27-6b6567696d39 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:04.923054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f2e9a-aded-4f70-af27-6b6567696d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:04.923054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f2e9a-aded-4f70-af27-6b6567696d39 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:04.923054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f2e9a-aded-4f70-af27-6b6567696d39 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:04.925482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f2e9a-aded-4f70-af27-6b6567696d39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:04.925482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f2e9a-aded-4f70-af27-6b6567696d39 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:04.932275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 347/704] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 4 18:44:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:05.039084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310197a-16c9-4c5c-9ca5-e3766059b591 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:05.074516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32a92-a8b5-4de3-b49b-525086af5935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:05.075335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32a92-a8b5-4de3-b49b-525086af5935 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:05.075612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32a92-a8b5-4de3-b49b-525086af5935 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:05.075883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32a92-a8b5-4de3-b49b-525086af5935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:05.087040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32a92-a8b5-4de3-b49b-525086af5935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:05.088502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32a92-a8b5-4de3-b49b-525086af5935 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-42b32a92-a8b5-4de3-b49b-525086af5935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:05.106816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:05.107797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:05.108685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:05.108685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:05.108685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:05.108685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:05.108685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 358/705] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:05.113994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f2e9a-aded-4f70-af27-6b6567696d39 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:05.220804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f2e9a-aded-4f70-af27-6b6567696d39 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:05.245524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75a33e-baa5-476b-a0fb-54e37f5a283d None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:05.245853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75a33e-baa5-476b-a0fb-54e37f5a283d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:05.246344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75a33e-baa5-476b-a0fb-54e37f5a283d None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:05.248411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 359/706] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:05.254012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e3d7d-1d09-4e90-81dc-f76a78ea118c None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:05.254294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e3d7d-1d09-4e90-81dc-f76a78ea118c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:05.254909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e3d7d-1d09-4e90-81dc-f76a78ea118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:05.263891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847dd2-dde1-46b3-90c5-b04bc59c6e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:05.264562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847dd2-dde1-46b3-90c5-b04bc59c6e99 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:05.264842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847dd2-dde1-46b3-90c5-b04bc59c6e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:05.265116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847dd2-dde1-46b3-90c5-b04bc59c6e99 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:05.265890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847dd2-dde1-46b3-90c5-b04bc59c6e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:05.266200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847dd2-dde1-46b3-90c5-b04bc59c6e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:05.267629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847dd2-dde1-46b3-90c5-b04bc59c6e99 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:05.272910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-af3e3d7d-1d09-4e90-81dc-f76a78ea118c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:05.274125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-af3e3d7d-1d09-4e90-81dc-f76a78ea118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:05.285448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 348/707] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:05.286705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847dd2-dde1-46b3-90c5-b04bc59c6e99 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:05.353931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 360/708] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:44:05.378507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e3d7d-1d09-4e90-81dc-f76a78ea118c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:05.399764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847dd2-dde1-46b3-90c5-b04bc59c6e99 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:05.433743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69ac6a-5c16-4413-b42d-20c4b2650276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:05.434557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ac6a-5c16-4413-b42d-20c4b2650276 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:05.435013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ac6a-5c16-4413-b42d-20c4b2650276 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:05.435290 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ac6a-5c16-4413-b42d-20c4b2650276 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:05.448009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69ac6a-5c16-4413-b42d-20c4b2650276 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:05.449498 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69ac6a-5c16-4413-b42d-20c4b2650276 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-9f69ac6a-5c16-4413-b42d-20c4b2650276 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:05.469604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:05.471682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:05.473836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:05.473836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:05.473836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:05.473836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:05.473836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:05.473836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:05.473836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:05.473836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:05.477324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 349/709] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:05.477324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69ac6a-5c16-4413-b42d-20c4b2650276 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:05.479298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e3d7d-1d09-4e90-81dc-f76a78ea118c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:05.545954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285261c-df12-4e18-9744-a2b319729993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:05.546755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285261c-df12-4e18-9744-a2b319729993 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:05.547032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285261c-df12-4e18-9744-a2b319729993 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:05.547304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285261c-df12-4e18-9744-a2b319729993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:05.574417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285261c-df12-4e18-9744-a2b319729993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:05.575880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285261c-df12-4e18-9744-a2b319729993 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:05.591096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69ac6a-5c16-4413-b42d-20c4b2650276 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-5285261c-df12-4e18-9744-a2b319729993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:05.613518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:05.615584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:05.617749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:05.617749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:05.617749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:05.617749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:05.617749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 361/710] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:05.620846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285261c-df12-4e18-9744-a2b319729993 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:05.634425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef285b4e-1471-47ef-a896-e904fcb49fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:05.635295 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef285b4e-1471-47ef-a896-e904fcb49fc7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:05.635578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef285b4e-1471-47ef-a896-e904fcb49fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:05.635856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef285b4e-1471-47ef-a896-e904fcb49fc7 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:05.636667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef285b4e-1471-47ef-a896-e904fcb49fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:05.636983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef285b4e-1471-47ef-a896-e904fcb49fc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:05.638463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef285b4e-1471-47ef-a896-e904fcb49fc7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:05.670384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 350/711] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:05.672036 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef285b4e-1471-47ef-a896-e904fcb49fc7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:05.824120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285261c-df12-4e18-9744-a2b319729993 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:05.864757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef285b4e-1471-47ef-a896-e904fcb49fc7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:05.899383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79589160-750e-4811-a064-0e00e52099fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:05.900294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79589160-750e-4811-a064-0e00e52099fc None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:05.900694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79589160-750e-4811-a064-0e00e52099fc None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:05.901108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79589160-750e-4811-a064-0e00e52099fc None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:05.902278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79589160-750e-4811-a064-0e00e52099fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:05.902621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79589160-750e-4811-a064-0e00e52099fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:05.904083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79589160-750e-4811-a064-0e00e52099fc None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:05.931571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 362/712] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:05.938478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79589160-750e-4811-a064-0e00e52099fc None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:05.939815 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560fd7b-410e-447a-b89d-6b14cd5c67ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:05.940486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560fd7b-410e-447a-b89d-6b14cd5c67ce None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:05.940798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560fd7b-410e-447a-b89d-6b14cd5c67ce None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:05.941068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560fd7b-410e-447a-b89d-6b14cd5c67ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:05.941945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560fd7b-410e-447a-b89d-6b14cd5c67ce None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=d94a895e3a3547ff9cf35d808c595071) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:05.942250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560fd7b-410e-447a-b89d-6b14cd5c67ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:05.943688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560fd7b-410e-447a-b89d-6b14cd5c67ce None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:05.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 351/713] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:05 2022] GET /identity/v3/role_assignments?user.id=d94a895e3a3547ff9cf35d808c595071&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:06.114353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79589160-750e-4811-a064-0e00e52099fc None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:06.165903 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8a45f-4700-43f5-a1c4-1f8a2074fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:06.166508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8a45f-4700-43f5-a1c4-1f8a2074fd5c None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:06.166790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8a45f-4700-43f5-a1c4-1f8a2074fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:06.167063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8a45f-4700-43f5-a1c4-1f8a2074fd5c None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:06.167782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8a45f-4700-43f5-a1c4-1f8a2074fd5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:06.169269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8a45f-4700-43f5-a1c4-1f8a2074fd5c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:06.202421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 363/714] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:44:05 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:44:06.231250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6269b2-f791-480f-980f-132e0475e091 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:06.231946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6269b2-f791-480f-980f-132e0475e091 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:06.232469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6269b2-f791-480f-980f-132e0475e091 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:06.234327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 352/715] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:06.240227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56727741-279f-4560-8c0b-57708ad20010 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:06.240563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56727741-279f-4560-8c0b-57708ad20010 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:06.240755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56727741-279f-4560-8c0b-57708ad20010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:06.260112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-56727741-279f-4560-8c0b-57708ad20010 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:06.261398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-56727741-279f-4560-8c0b-57708ad20010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:06.338563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 364/716] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:44:06.361910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6269b2-f791-480f-980f-132e0475e091 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:06.494142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6269b2-f791-480f-980f-132e0475e091 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:06.537584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2fd39-dbee-4632-9a3c-f4d60d36d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:06.538392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2fd39-dbee-4632-9a3c-f4d60d36d80c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:06.538674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2fd39-dbee-4632-9a3c-f4d60d36d80c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:06.538943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2fd39-dbee-4632-9a3c-f4d60d36d80c None admin] PATH_INFO: `/v3/services/network` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:06.539606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2fd39-dbee-4632-9a3c-f4d60d36d80c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:06.540988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2fd39-dbee-4632-9a3c-f4d60d36d80c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-0ba2fd39-dbee-4632-9a3c-f4d60d36d80c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:06.556114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:06.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:44:06.558042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:06.561390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 353/717] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:06 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:06.563921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56727741-279f-4560-8c0b-57708ad20010 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:06.805124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56727741-279f-4560-8c0b-57708ad20010 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:06.838487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3e448-e8b6-4739-bf1f-677fdb831af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:06.839590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e448-e8b6-4739-bf1f-677fdb831af2 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:06.840071 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e448-e8b6-4739-bf1f-677fdb831af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:06.840542 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e448-e8b6-4739-bf1f-677fdb831af2 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:06.841561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3e448-e8b6-4739-bf1f-677fdb831af2 None admin] RBAC: Adding query filter params (name=network) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:06.842086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3e448-e8b6-4739-bf1f-677fdb831af2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:06.843711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3e448-e8b6-4739-bf1f-677fdb831af2 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:06.850045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 365/718] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:06.855391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2fd39-dbee-4632-9a3c-f4d60d36d80c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:07.009082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2fd39-dbee-4632-9a3c-f4d60d36d80c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:07.061215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c28f55-0fc6-486e-85d3-a3e67fc1aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:07.061881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c28f55-0fc6-486e-85d3-a3e67fc1aa17 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:07.062186 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c28f55-0fc6-486e-85d3-a3e67fc1aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:07.062479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c28f55-0fc6-486e-85d3-a3e67fc1aa17 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:07.063200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c28f55-0fc6-486e-85d3-a3e67fc1aa17 None admin] RBAC: Adding query filter params (type=network) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:07.063507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c28f55-0fc6-486e-85d3-a3e67fc1aa17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:07.064875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c28f55-0fc6-486e-85d3-a3e67fc1aa17 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:07.070126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 354/719] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:07.209745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97531d14-dfec-4c49-8ead-0c21551113a2 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:07.210514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97531d14-dfec-4c49-8ead-0c21551113a2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:07.211015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97531d14-dfec-4c49-8ead-0c21551113a2 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:07.212858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 366/720] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:07.218593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae5f8b-fcec-45d6-abce-9f068f290228 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:07.218881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae5f8b-fcec-45d6-abce-9f068f290228 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:07.219150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae5f8b-fcec-45d6-abce-9f068f290228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:07.242653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-fdae5f8b-fcec-45d6-abce-9f068f290228 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:07.244550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-fdae5f8b-fcec-45d6-abce-9f068f290228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:07.334790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 355/721] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:44:07.368080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97531d14-dfec-4c49-8ead-0c21551113a2 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:07.479075 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97531d14-dfec-4c49-8ead-0c21551113a2 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:07.518989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76fcb4-ad89-42eb-83b9-e7c23b929b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:07.519835 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76fcb4-ad89-42eb-83b9-e7c23b929b5c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:07.520112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76fcb4-ad89-42eb-83b9-e7c23b929b5c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:07.520448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76fcb4-ad89-42eb-83b9-e7c23b929b5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:07.532905 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76fcb4-ad89-42eb-83b9-e7c23b929b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-ee76fcb4-ad89-42eb-83b9-e7c23b929b5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:07.540777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:07.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:07.543376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 367/722] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:07.550463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae5f8b-fcec-45d6-abce-9f068f290228 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:07.704682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae5f8b-fcec-45d6-abce-9f068f290228 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:07.716214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd574-0100-451c-8688-5016dd816bdc None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:07.716526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd574-0100-451c-8688-5016dd816bdc None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:07.716801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd574-0100-451c-8688-5016dd816bdc None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:07.718431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 368/723] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:07.724783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25915f-f6b3-466d-8f1d-b53b809ddbf5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:07.726029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25915f-f6b3-466d-8f1d-b53b809ddbf5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:07.726658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25915f-f6b3-466d-8f1d-b53b809ddbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:07.754377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-dc25915f-f6b3-466d-8f1d-b53b809ddbf5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:07.755396 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-dc25915f-f6b3-466d-8f1d-b53b809ddbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:07.777312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fa21-de8e-4670-8acd-eb7261b8999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:07.777999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fa21-de8e-4670-8acd-eb7261b8999a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:07.778276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fa21-de8e-4670-8acd-eb7261b8999a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:07.778544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fa21-de8e-4670-8acd-eb7261b8999a None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:07.779301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9fa21-de8e-4670-8acd-eb7261b8999a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:07.779603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9fa21-de8e-4670-8acd-eb7261b8999a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:07.780970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9fa21-de8e-4670-8acd-eb7261b8999a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:07.801125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 356/724] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:07.806916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fa21-de8e-4670-8acd-eb7261b8999a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:07.892554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 369/725] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:44:07.924523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fa21-de8e-4670-8acd-eb7261b8999a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:07.942120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25915f-f6b3-466d-8f1d-b53b809ddbf5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:07.982609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33201dd8-2f3c-48e2-addc-8845c2b9b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:07.983347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201dd8-2f3c-48e2-addc-8845c2b9b9fd None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:07.983629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201dd8-2f3c-48e2-addc-8845c2b9b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:07.983904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201dd8-2f3c-48e2-addc-8845c2b9b9fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:08.011202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33201dd8-2f3c-48e2-addc-8845c2b9b9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:08.012657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33201dd8-2f3c-48e2-addc-8845c2b9b9fd None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:08.036573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25915f-f6b3-466d-8f1d-b53b809ddbf5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-33201dd8-2f3c-48e2-addc-8845c2b9b9fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:08.039883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:08.040800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:08.041749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:08.041749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:08.041749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:08.041749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:08.049710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 357/726] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:08.054958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33201dd8-2f3c-48e2-addc-8845c2b9b9fd None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:08.069325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188e0cf-44ef-4e61-8e84-82d1c24d016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:08.070069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188e0cf-44ef-4e61-8e84-82d1c24d016c None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:08.070351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188e0cf-44ef-4e61-8e84-82d1c24d016c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:08.070634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188e0cf-44ef-4e61-8e84-82d1c24d016c None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:08.071359 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188e0cf-44ef-4e61-8e84-82d1c24d016c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:08.072720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188e0cf-44ef-4e61-8e84-82d1c24d016c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:08.091270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 370/727] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:44:07 2022] POST /identity/v3/services => generated 251 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:44:08.188333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33201dd8-2f3c-48e2-addc-8845c2b9b9fd None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:08.230252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a58231-941f-4dba-b6be-89f4e068caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:08.230911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58231-941f-4dba-b6be-89f4e068caf6 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:08.231185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58231-941f-4dba-b6be-89f4e068caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:08.231454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58231-941f-4dba-b6be-89f4e068caf6 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:08.232179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a58231-941f-4dba-b6be-89f4e068caf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:08.232531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a58231-941f-4dba-b6be-89f4e068caf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:08.233998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a58231-941f-4dba-b6be-89f4e068caf6 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:08.247400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 358/728] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:08.254653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188e0cf-44ef-4e61-8e84-82d1c24d016c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:08.362875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188e0cf-44ef-4e61-8e84-82d1c24d016c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:08.397351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed8f33-ac6e-4cf1-b4b7-bd0efae9efa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:08.398133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed8f33-ac6e-4cf1-b4b7-bd0efae9efa2 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:08.398400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed8f33-ac6e-4cf1-b4b7-bd0efae9efa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:08.398670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed8f33-ac6e-4cf1-b4b7-bd0efae9efa2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:08.407144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed8f33-ac6e-4cf1-b4b7-bd0efae9efa2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:08.408599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed8f33-ac6e-4cf1-b4b7-bd0efae9efa2 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-27ed8f33-ac6e-4cf1-b4b7-bd0efae9efa2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:08.423680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:08.425769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:08.427003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 371/729] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 4 18:44:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:08.431354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a58231-941f-4dba-b6be-89f4e068caf6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:08.529564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a58231-941f-4dba-b6be-89f4e068caf6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:08.566713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635689c-4d8d-4ec7-9687-c55800026e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:08.569035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635689c-4d8d-4ec7-9687-c55800026e35 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:08.569035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635689c-4d8d-4ec7-9687-c55800026e35 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:08.569035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635689c-4d8d-4ec7-9687-c55800026e35 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:08.569502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635689c-4d8d-4ec7-9687-c55800026e35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:08.569502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635689c-4d8d-4ec7-9687-c55800026e35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:08.570932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635689c-4d8d-4ec7-9687-c55800026e35 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:08.588985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 359/730] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 4 18:44:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:08.594140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed8f33-ac6e-4cf1-b4b7-bd0efae9efa2 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:08.708158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed8f33-ac6e-4cf1-b4b7-bd0efae9efa2 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:08.740960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29a72f-c173-4093-b032-fdae21c29305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:08.742119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29a72f-c173-4093-b032-fdae21c29305 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:08.742570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29a72f-c173-4093-b032-fdae21c29305 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:08.743009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29a72f-c173-4093-b032-fdae21c29305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:08.754063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29a72f-c173-4093-b032-fdae21c29305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:08.755713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29a72f-c173-4093-b032-fdae21c29305 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-8a29a72f-c173-4093-b032-fdae21c29305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:08.773014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:08.773975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:08.774870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:08.774870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:08.774870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:08.774870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:08.776765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 372/731] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:08.781999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635689c-4d8d-4ec7-9687-c55800026e35 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:08.826903 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634fa04-ae36-4acb-9d3d-6e5d27cd89f4 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:08.827424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634fa04-ae36-4acb-9d3d-6e5d27cd89f4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:08.827842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634fa04-ae36-4acb-9d3d-6e5d27cd89f4 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:08.829594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 373/732] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:08.837153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708140e-c476-4f8b-8d90-c174ac2eee82 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:08.837917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708140e-c476-4f8b-8d90-c174ac2eee82 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:08.838337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708140e-c476-4f8b-8d90-c174ac2eee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:08.856939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d708140e-c476-4f8b-8d90-c174ac2eee82 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:08.858365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d708140e-c476-4f8b-8d90-c174ac2eee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:08.933714 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 374/733] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 18:44:08.951058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635689c-4d8d-4ec7-9687-c55800026e35 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:08.968691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708140e-c476-4f8b-8d90-c174ac2eee82 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:08.995533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29038297-63d9-47c9-a30c-b7f9aaea5fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:08.996219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29038297-63d9-47c9-a30c-b7f9aaea5fc0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:08.996510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29038297-63d9-47c9-a30c-b7f9aaea5fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:08.996784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29038297-63d9-47c9-a30c-b7f9aaea5fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:08.997550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29038297-63d9-47c9-a30c-b7f9aaea5fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:08.997861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29038297-63d9-47c9-a30c-b7f9aaea5fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:08.999224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29038297-63d9-47c9-a30c-b7f9aaea5fc0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:09.011689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 360/734] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:09.018225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29038297-63d9-47c9-a30c-b7f9aaea5fc0 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:09.104223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708140e-c476-4f8b-8d90-c174ac2eee82 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:09.118090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29038297-63d9-47c9-a30c-b7f9aaea5fc0 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:09.148808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce1eaa-754f-4789-80b4-ce2a4f37d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:09.150221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce1eaa-754f-4789-80b4-ce2a4f37d973 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.151140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce1eaa-754f-4789-80b4-ce2a4f37d973 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.152014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce1eaa-754f-4789-80b4-ce2a4f37d973 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.155687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf61c8-96c4-431f-bc1e-16fc3b2bb321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:09.156497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf61c8-96c4-431f-bc1e-16fc3b2bb321 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.156776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf61c8-96c4-431f-bc1e-16fc3b2bb321 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.157070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf61c8-96c4-431f-bc1e-16fc3b2bb321 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.164041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf61c8-96c4-431f-bc1e-16fc3b2bb321 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:09.165509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf61c8-96c4-431f-bc1e-16fc3b2bb321 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:09.165837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce1eaa-754f-4789-80b4-ce2a4f37d973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-68ce1eaa-754f-4789-80b4-ce2a4f37d973 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:09.173585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:09.174521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:09.175428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:09.178286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 375/735] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-6ccf61c8-96c4-431f-bc1e-16fc3b2bb321 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:09.179685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:09.180566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:09.181825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:09.181825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:09.181825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:09.181825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:09.181825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:09.181825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:09.181825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:09.181825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:09.181825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 361/736] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:09.182321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdbdeb-1ec3-44cf-8e15-19359639ee7e None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.182321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdbdeb-1ec3-44cf-8e15-19359639ee7e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.182321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdbdeb-1ec3-44cf-8e15-19359639ee7e None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.186771 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 376/737] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:09.186904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf61c8-96c4-431f-bc1e-16fc3b2bb321 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:09.189160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdbdeb-1ec3-44cf-8e15-19359639ee7e None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:09.299573 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf61c8-96c4-431f-bc1e-16fc3b2bb321 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:09.308315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdbdeb-1ec3-44cf-8e15-19359639ee7e None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:09.337249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72496-887b-4881-99d4-41dd08a9ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:09.338160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72496-887b-4881-99d4-41dd08a9ef8c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.338448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72496-887b-4881-99d4-41dd08a9ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.338736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72496-887b-4881-99d4-41dd08a9ef8c None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.339485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c72496-887b-4881-99d4-41dd08a9ef8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:09.339795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c72496-887b-4881-99d4-41dd08a9ef8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:09.341237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c72496-887b-4881-99d4-41dd08a9ef8c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:09.349915 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 362/738] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:09.351431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3c596-ba37-4ae7-88d2-5002a67a3252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:09.351582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db867f1-d7ff-4e03-852c-8d1b7d2960da None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.351582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db867f1-d7ff-4e03-852c-8d1b7d2960da None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.351729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db867f1-d7ff-4e03-852c-8d1b7d2960da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.352682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3c596-ba37-4ae7-88d2-5002a67a3252 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.356700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3c596-ba37-4ae7-88d2-5002a67a3252 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.358081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3c596-ba37-4ae7-88d2-5002a67a3252 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.359105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3c596-ba37-4ae7-88d2-5002a67a3252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:09.359611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3c596-ba37-4ae7-88d2-5002a67a3252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:09.361237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3c596-ba37-4ae7-88d2-5002a67a3252 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:09.368946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3db867f1-d7ff-4e03-852c-8d1b7d2960da None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:09.370154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3db867f1-d7ff-4e03-852c-8d1b7d2960da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:09.376593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 377/739] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:09.377829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3c596-ba37-4ae7-88d2-5002a67a3252 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:09.435697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 363/740] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:44:09.436518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db867f1-d7ff-4e03-852c-8d1b7d2960da None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:09.503251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3c596-ba37-4ae7-88d2-5002a67a3252 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:09.542620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80089d-30f4-4224-99ab-5de565e7d4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:09.543570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80089d-30f4-4224-99ab-5de565e7d4bd None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.544158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80089d-30f4-4224-99ab-5de565e7d4bd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.544444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80089d-30f4-4224-99ab-5de565e7d4bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.549742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db867f1-d7ff-4e03-852c-8d1b7d2960da None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:09.556573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80089d-30f4-4224-99ab-5de565e7d4bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:09.558065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80089d-30f4-4224-99ab-5de565e7d4bd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-2b80089d-30f4-4224-99ab-5de565e7d4bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:09.578931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:09.579908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:09.580974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:09.580974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:09.580974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:09.580974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:09.580974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 378/741] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:09.581329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80089d-30f4-4224-99ab-5de565e7d4bd None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:09.595649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742af0-608e-48a5-9994-08994a86a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:09.596813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742af0-608e-48a5-9994-08994a86a881 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.597099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742af0-608e-48a5-9994-08994a86a881 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.597817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742af0-608e-48a5-9994-08994a86a881 None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/3938216005694c45bd6126415930d014/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.600277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf742af0-608e-48a5-9994-08994a86a881 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=3938216005694c45bd6126415930d014, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:09.602089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf742af0-608e-48a5-9994-08994a86a881 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:09.619908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 364/742] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:44:09 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/3938216005694c45bd6126415930d014/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:44:09.620749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742af0-608e-48a5-9994-08994a86a881 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:09.757996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80089d-30f4-4224-99ab-5de565e7d4bd None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:09.806589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8880d-75dd-4025-a1dc-8c02133e7f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:09.807464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8880d-75dd-4025-a1dc-8c02133e7f88 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.807745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8880d-75dd-4025-a1dc-8c02133e7f88 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.808013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8880d-75dd-4025-a1dc-8c02133e7f88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.828565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8880d-75dd-4025-a1dc-8c02133e7f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:09.837808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742af0-608e-48a5-9994-08994a86a881 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-52d8880d-75dd-4025-a1dc-8c02133e7f88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:09.847213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:09.848275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:44:09.849175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:09.850971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 379/743] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:44:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:09.858923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8880d-75dd-4025-a1dc-8c02133e7f88 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:09.891875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b79799-7ac7-4c23-9f11-9faf4f6019b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:09.892472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b79799-7ac7-4c23-9f11-9faf4f6019b0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.892751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b79799-7ac7-4c23-9f11-9faf4f6019b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.893017 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b79799-7ac7-4c23-9f11-9faf4f6019b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.893963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b79799-7ac7-4c23-9f11-9faf4f6019b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:09.894276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b79799-7ac7-4c23-9f11-9faf4f6019b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:09.895620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b79799-7ac7-4c23-9f11-9faf4f6019b0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:09.907546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 365/744] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:09.908969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612a052-eb86-493a-9395-c510c27d44cf None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.909131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612a052-eb86-493a-9395-c510c27d44cf None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.909494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612a052-eb86-493a-9395-c510c27d44cf None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.910976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 366/745] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:09.917393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fb490-b5f9-41e3-9de9-ebbb0c299303 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:09.917393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fb490-b5f9-41e3-9de9-ebbb0c299303 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:09.917393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fb490-b5f9-41e3-9de9-ebbb0c299303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:09.937499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-352fb490-b5f9-41e3-9de9-ebbb0c299303 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:09.938824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-352fb490-b5f9-41e3-9de9-ebbb0c299303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:09.967386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8880d-75dd-4025-a1dc-8c02133e7f88 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:10.003150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0857c1-de4f-4dd4-ba24-6cf12fd32df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:10.003816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0857c1-de4f-4dd4-ba24-6cf12fd32df2 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:10.004086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0857c1-de4f-4dd4-ba24-6cf12fd32df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:10.004357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0857c1-de4f-4dd4-ba24-6cf12fd32df2 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:10.005117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0857c1-de4f-4dd4-ba24-6cf12fd32df2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:10.005445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0857c1-de4f-4dd4-ba24-6cf12fd32df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:10.006859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0857c1-de4f-4dd4-ba24-6cf12fd32df2 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:10.014959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 380/746] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:44:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:10.015759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0857c1-de4f-4dd4-ba24-6cf12fd32df2 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:10.020536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 367/747] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 18:44:10.026749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fb490-b5f9-41e3-9de9-ebbb0c299303 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:10.129750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0857c1-de4f-4dd4-ba24-6cf12fd32df2 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:10.147920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fb490-b5f9-41e3-9de9-ebbb0c299303 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:10.161907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1c84-8970-4984-ab47-7e0db3f7d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:10.162630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1c84-8970-4984-ab47-7e0db3f7d8ea None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:10.162908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1c84-8970-4984-ab47-7e0db3f7d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:10.163180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1c84-8970-4984-ab47-7e0db3f7d8ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:10.170762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a1c84-8970-4984-ab47-7e0db3f7d8ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:10.172190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a1c84-8970-4984-ab47-7e0db3f7d8ea None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-3f0a1c84-8970-4984-ab47-7e0db3f7d8ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:10.187205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:10.188227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:44:10.189202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:10.190344 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66fd40-876a-46ff-88b9-bdda4d432b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:10.191426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66fd40-876a-46ff-88b9-bdda4d432b05 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:10.191891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66fd40-876a-46ff-88b9-bdda4d432b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:10.192375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66fd40-876a-46ff-88b9-bdda4d432b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:10.194214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 381/748] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:10.195042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1c84-8970-4984-ab47-7e0db3f7d8ea None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:10.204762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66fd40-876a-46ff-88b9-bdda4d432b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:10.206656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66fd40-876a-46ff-88b9-bdda4d432b05 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-3c66fd40-876a-46ff-88b9-bdda4d432b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:10.229460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:10.230457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:10.231378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:10.231378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:10.231378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:10.231378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:10.231378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 368/749] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:10.232090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66fd40-876a-46ff-88b9-bdda4d432b05 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:10.291068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1c84-8970-4984-ab47-7e0db3f7d8ea None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:10.323537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a161c2-917f-4e41-aba4-ae9ed431b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:10.324204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a161c2-917f-4e41-aba4-ae9ed431b0d3 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:10.324533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a161c2-917f-4e41-aba4-ae9ed431b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:10.324819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a161c2-917f-4e41-aba4-ae9ed431b0d3 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:10.325576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a161c2-917f-4e41-aba4-ae9ed431b0d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:10.326937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a161c2-917f-4e41-aba4-ae9ed431b0d3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:10.344526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 382/750] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:44:10 2022] POST /identity/v3/services => generated 240 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:10.345644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a161c2-917f-4e41-aba4-ae9ed431b0d3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:10.360337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66fd40-876a-46ff-88b9-bdda4d432b05 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:10.474014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917643e-bc02-4a10-8ce4-bfa8c2d19a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:10.474703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917643e-bc02-4a10-8ce4-bfa8c2d19a70 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:10.474986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917643e-bc02-4a10-8ce4-bfa8c2d19a70 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:10.475257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917643e-bc02-4a10-8ce4-bfa8c2d19a70 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:10.476125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917643e-bc02-4a10-8ce4-bfa8c2d19a70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:10.476433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917643e-bc02-4a10-8ce4-bfa8c2d19a70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:10.477948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917643e-bc02-4a10-8ce4-bfa8c2d19a70 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:10.516158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a161c2-917f-4e41-aba4-ae9ed431b0d3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:10.520810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 369/751] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 4 18:44:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:10.530889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917643e-bc02-4a10-8ce4-bfa8c2d19a70 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:10.573181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430da0b-59de-4b61-9c62-27f931494617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:10.573906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430da0b-59de-4b61-9c62-27f931494617 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:10.574181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430da0b-59de-4b61-9c62-27f931494617 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:10.574448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430da0b-59de-4b61-9c62-27f931494617 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:10.575804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430da0b-59de-4b61-9c62-27f931494617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:10.576117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430da0b-59de-4b61-9c62-27f931494617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:10.577937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430da0b-59de-4b61-9c62-27f931494617 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:10.596021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 383/752] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:10.601682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430da0b-59de-4b61-9c62-27f931494617 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:10.669056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917643e-bc02-4a10-8ce4-bfa8c2d19a70 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:10.717036 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91390bf7-b610-475f-8dbf-363fa449a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:10.718252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91390bf7-b610-475f-8dbf-363fa449a18f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:10.718533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91390bf7-b610-475f-8dbf-363fa449a18f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:10.718802 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91390bf7-b610-475f-8dbf-363fa449a18f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:10.719837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430da0b-59de-4b61-9c62-27f931494617 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:10.763221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ed78-d064-479f-8559-81c9c17fa8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:10.764047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ed78-d064-479f-8559-81c9c17fa8c9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:10.764319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ed78-d064-479f-8559-81c9c17fa8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:10.764588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ed78-d064-479f-8559-81c9c17fa8c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:10.774145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4ed78-d064-479f-8559-81c9c17fa8c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:10.775791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4ed78-d064-479f-8559-81c9c17fa8c9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-52e4ed78-d064-479f-8559-81c9c17fa8c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:10.794609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:10.796795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:10.798046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 384/753] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:44:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:10.804385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91390bf7-b610-475f-8dbf-363fa449a18f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:10.806470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ed78-d064-479f-8559-81c9c17fa8c9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:10.809450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91390bf7-b610-475f-8dbf-363fa449a18f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:10.917329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 370/754] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:44:10.923552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91390bf7-b610-475f-8dbf-363fa449a18f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:11.023881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ed78-d064-479f-8559-81c9c17fa8c9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:11.057944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900837b-2c37-4f4e-9e67-73b72b57e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:11.058960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900837b-2c37-4f4e-9e67-73b72b57e66b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.059439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900837b-2c37-4f4e-9e67-73b72b57e66b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.059930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900837b-2c37-4f4e-9e67-73b72b57e66b None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.060982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900837b-2c37-4f4e-9e67-73b72b57e66b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:11.061539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900837b-2c37-4f4e-9e67-73b72b57e66b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:11.063158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900837b-2c37-4f4e-9e67-73b72b57e66b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:11.069958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91390bf7-b610-475f-8dbf-363fa449a18f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:11.085377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 385/755] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 4 18:44:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:11.086964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee96136-efc4-4dea-abd4-1dade81b0982 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.087451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee96136-efc4-4dea-abd4-1dade81b0982 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.087923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee96136-efc4-4dea-abd4-1dade81b0982 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.089630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 386/756] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:11.090503 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee96136-efc4-4dea-abd4-1dade81b0982 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:11.103024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d841b4e-cc79-4363-8fd0-e57201641de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:11.103776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d841b4e-cc79-4363-8fd0-e57201641de2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.104054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d841b4e-cc79-4363-8fd0-e57201641de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.104322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d841b4e-cc79-4363-8fd0-e57201641de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.114666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d841b4e-cc79-4363-8fd0-e57201641de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:11.116099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d841b4e-cc79-4363-8fd0-e57201641de2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-4d841b4e-cc79-4363-8fd0-e57201641de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:11.134065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:11.134982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:11.135890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:11.135890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:11.135890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:11.135890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:11.139968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 371/757] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:11.141250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810430a-ede4-4a8b-b089-680c6675f98d None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.141713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810430a-ede4-4a8b-b089-680c6675f98d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.141819 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810430a-ede4-4a8b-b089-680c6675f98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.158485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-2810430a-ede4-4a8b-b089-680c6675f98d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:11.159724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2810430a-ede4-4a8b-b089-680c6675f98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:11.198338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee96136-efc4-4dea-abd4-1dade81b0982 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:11.232191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76ee8c-16b3-40a6-ac02-9fd78ae90b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:11.233211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76ee8c-16b3-40a6-ac02-9fd78ae90b78 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.233718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76ee8c-16b3-40a6-ac02-9fd78ae90b78 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.234240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76ee8c-16b3-40a6-ac02-9fd78ae90b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.241305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 372/758] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:11.241305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810430a-ede4-4a8b-b089-680c6675f98d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:11.312512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76ee8c-16b3-40a6-ac02-9fd78ae90b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:11.314065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76ee8c-16b3-40a6-ac02-9fd78ae90b78 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:11.375225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810430a-ede4-4a8b-b089-680c6675f98d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:11.423749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 387/759] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:44:11.423749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76ee8c-16b3-40a6-ac02-9fd78ae90b78 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:11.532252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76ee8c-16b3-40a6-ac02-9fd78ae90b78 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:11.553861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c1153-172f-4459-8698-d96d5420f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:11.554534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c1153-172f-4459-8698-d96d5420f203 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.554814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c1153-172f-4459-8698-d96d5420f203 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.555091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c1153-172f-4459-8698-d96d5420f203 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.555822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c1153-172f-4459-8698-d96d5420f203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:11.556132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c1153-172f-4459-8698-d96d5420f203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:11.557545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c1153-172f-4459-8698-d96d5420f203 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:11.568929 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 373/760] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:11.569855 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c1153-172f-4459-8698-d96d5420f203 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:11.581317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d9e2c-a696-4d59-ac1c-bb64e01718f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:11.581317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d9e2c-a696-4d59-ac1c-bb64e01718f6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.581317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d9e2c-a696-4d59-ac1c-bb64e01718f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.581317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d9e2c-a696-4d59-ac1c-bb64e01718f6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.581736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d9e2c-a696-4d59-ac1c-bb64e01718f6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:11.581736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d9e2c-a696-4d59-ac1c-bb64e01718f6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-fb5d9e2c-a696-4d59-ac1c-bb64e01718f6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:11.599029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:11.600024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:44:11.600877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:11.601708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 388/761] 10.222.0.35 () {56 vars in 1129 bytes} [Wed May 4 18:44:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:11.602304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d9e2c-a696-4d59-ac1c-bb64e01718f6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:11.680287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c1153-172f-4459-8698-d96d5420f203 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:11.714505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e1db6-5791-4e87-b564-bfbbf5704d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:11.715766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e1db6-5791-4e87-b564-bfbbf5704d52 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.716049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e1db6-5791-4e87-b564-bfbbf5704d52 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.716321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e1db6-5791-4e87-b564-bfbbf5704d52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.718067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d9e2c-a696-4d59-ac1c-bb64e01718f6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:11.729328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e1db6-5791-4e87-b564-bfbbf5704d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:11.731300 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e1db6-5791-4e87-b564-bfbbf5704d52 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-5e7e1db6-5791-4e87-b564-bfbbf5704d52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:11.754961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:11.756040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:11.756954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:11.756954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:11.756954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:11.756954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:11.757188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 374/762] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:11.762388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e1db6-5791-4e87-b564-bfbbf5704d52 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:11.764218 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04bbba-a277-4d34-9763-4b6babfbc2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:11.765256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04bbba-a277-4d34-9763-4b6babfbc2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.765786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04bbba-a277-4d34-9763-4b6babfbc2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.766253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04bbba-a277-4d34-9763-4b6babfbc2a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.773586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04bbba-a277-4d34-9763-4b6babfbc2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:11.775309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04bbba-a277-4d34-9763-4b6babfbc2a5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-0c04bbba-a277-4d34-9763-4b6babfbc2a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:11.789877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:11.790795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:11.791713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:11.791713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:11.791713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:11.791713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:11.791713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:11.791713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:11.791713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:11.791713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:11.794164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 389/763] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:11.795262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04bbba-a277-4d34-9763-4b6babfbc2a5 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:11.878436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e1db6-5791-4e87-b564-bfbbf5704d52 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:11.901128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04bbba-a277-4d34-9763-4b6babfbc2a5 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:11.917476 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a121ea-f770-411a-a100-643374f4b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:11.918147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a121ea-f770-411a-a100-643374f4b297 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.918430 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a121ea-f770-411a-a100-643374f4b297 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.918702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a121ea-f770-411a-a100-643374f4b297 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.919582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a121ea-f770-411a-a100-643374f4b297 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:11.919892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a121ea-f770-411a-a100-643374f4b297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:11.921593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a121ea-f770-411a-a100-643374f4b297 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:11.929358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 375/764] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 4 18:44:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:11.930455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a121ea-f770-411a-a100-643374f4b297 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:11.941445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d681645-1d22-4bf6-a89e-cb542502c6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:11.942470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d681645-1d22-4bf6-a89e-cb542502c6f3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:11.942949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d681645-1d22-4bf6-a89e-cb542502c6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:11.943442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d681645-1d22-4bf6-a89e-cb542502c6f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:11.944377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d681645-1d22-4bf6-a89e-cb542502c6f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:11.944893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d681645-1d22-4bf6-a89e-cb542502c6f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:11.946502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d681645-1d22-4bf6-a89e-cb542502c6f3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:11.962821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 390/765] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:11.963995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d681645-1d22-4bf6-a89e-cb542502c6f3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.053917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a121ea-f770-411a-a100-643374f4b297 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.065411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d681645-1d22-4bf6-a89e-cb542502c6f3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.086403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210effb2-da62-482c-8ec3-d9cb09a1e0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.087069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210effb2-da62-482c-8ec3-d9cb09a1e0dd None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.087348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210effb2-da62-482c-8ec3-d9cb09a1e0dd None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.087619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210effb2-da62-482c-8ec3-d9cb09a1e0dd None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.088403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210effb2-da62-482c-8ec3-d9cb09a1e0dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:12.088710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210effb2-da62-482c-8ec3-d9cb09a1e0dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:12.090151 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210effb2-da62-482c-8ec3-d9cb09a1e0dd None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:12.098334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3ec9c-a6b6-4293-b49d-f175e6a1e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.099003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3ec9c-a6b6-4293-b49d-f175e6a1e59e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.099283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3ec9c-a6b6-4293-b49d-f175e6a1e59e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.099558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3ec9c-a6b6-4293-b49d-f175e6a1e59e None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.100272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3ec9c-a6b6-4293-b49d-f175e6a1e59e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:12.100580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3ec9c-a6b6-4293-b49d-f175e6a1e59e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:12.101961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3ec9c-a6b6-4293-b49d-f175e6a1e59e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:12.103035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 376/766] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:12.103864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210effb2-da62-482c-8ec3-d9cb09a1e0dd None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.110356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 391/767] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 4 18:44:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:12.111667 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334949d-e43b-4c2d-9d44-fd44efa084c0 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.111960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334949d-e43b-4c2d-9d44-fd44efa084c0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.112267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334949d-e43b-4c2d-9d44-fd44efa084c0 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.113790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 392/768] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:12.114500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334949d-e43b-4c2d-9d44-fd44efa084c0 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.198217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210effb2-da62-482c-8ec3-d9cb09a1e0dd None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.211834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334949d-e43b-4c2d-9d44-fd44efa084c0 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.231088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11b702-9555-4355-8d0f-2da6434b1c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.231897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11b702-9555-4355-8d0f-2da6434b1c7b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.232161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11b702-9555-4355-8d0f-2da6434b1c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.232434 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11b702-9555-4355-8d0f-2da6434b1c7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.239149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11b702-9555-4355-8d0f-2da6434b1c7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:12.241510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11b702-9555-4355-8d0f-2da6434b1c7b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:12.246868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b375155-32ff-42ee-a250-97ba4d7fc981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.247512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b375155-32ff-42ee-a250-97ba4d7fc981 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.247787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b375155-32ff-42ee-a250-97ba4d7fc981 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.248053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b375155-32ff-42ee-a250-97ba4d7fc981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.248879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b375155-32ff-42ee-a250-97ba4d7fc981 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=d94a895e3a3547ff9cf35d808c595071) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:12.249187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b375155-32ff-42ee-a250-97ba4d7fc981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:12.250921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b375155-32ff-42ee-a250-97ba4d7fc981 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:12.261651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 393/769] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:12 2022] GET /identity/v3/role_assignments?user.id=d94a895e3a3547ff9cf35d808c595071&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-ff11b702-9555-4355-8d0f-2da6434b1c7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:12.261839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:12.262682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:12.263572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:12.263572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:12.263572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:12.263572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:12.263572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:12.263572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:12.263572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:12.263572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:12.264003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b375155-32ff-42ee-a250-97ba4d7fc981 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.264074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 377/770] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:12.264074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eea7f-61bf-4cc6-9026-e122250f0e72 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.264074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eea7f-61bf-4cc6-9026-e122250f0e72 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.264074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eea7f-61bf-4cc6-9026-e122250f0e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.280626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-4c0eea7f-61bf-4cc6-9026-e122250f0e72 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:12.281868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4c0eea7f-61bf-4cc6-9026-e122250f0e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:12.355370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 378/771] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:12.356267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0eea7f-61bf-4cc6-9026-e122250f0e72 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.404741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b375155-32ff-42ee-a250-97ba4d7fc981 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.450372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a5642-fa49-485f-873d-5e02ca86ed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.450971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5642-fa49-485f-873d-5e02ca86ed25 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.451247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5642-fa49-485f-873d-5e02ca86ed25 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.451540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5642-fa49-485f-873d-5e02ca86ed25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.455003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a5642-fa49-485f-873d-5e02ca86ed25 None admin] RBAC: Adding query filter params (interface=public, service_id=6185bbf00a434b07a61c82b79e26c589, region_id=RegionOne) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:12.455003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a5642-fa49-485f-873d-5e02ca86ed25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:12.455003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a5642-fa49-485f-873d-5e02ca86ed25 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:12.465915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 394/772] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 4 18:44:12 2022] GET /identity/v3/endpoints?service_id=6185bbf00a434b07a61c82b79e26c589&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:12.465915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a5642-fa49-485f-873d-5e02ca86ed25 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.481884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0eea7f-61bf-4cc6-9026-e122250f0e72 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.516126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c779844-038d-48c6-85d1-8478fb904814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.517144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779844-038d-48c6-85d1-8478fb904814 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.517663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779844-038d-48c6-85d1-8478fb904814 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.518126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779844-038d-48c6-85d1-8478fb904814 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.519157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c779844-038d-48c6-85d1-8478fb904814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:12.519654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c779844-038d-48c6-85d1-8478fb904814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:12.521265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c779844-038d-48c6-85d1-8478fb904814 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:12.538604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 379/773] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:12.539913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c779844-038d-48c6-85d1-8478fb904814 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.580174 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a5642-fa49-485f-873d-5e02ca86ed25 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.621324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149c1fb-f499-4ff8-8f05-bffeef94712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.622477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149c1fb-f499-4ff8-8f05-bffeef94712e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.622769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149c1fb-f499-4ff8-8f05-bffeef94712e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.623045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149c1fb-f499-4ff8-8f05-bffeef94712e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.636189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149c1fb-f499-4ff8-8f05-bffeef94712e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:12.645159 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c779844-038d-48c6-85d1-8478fb904814 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-c149c1fb-f499-4ff8-8f05-bffeef94712e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:12.645832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:12.646759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 395/774] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:12.652602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149c1fb-f499-4ff8-8f05-bffeef94712e None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.694464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ff60-ebfb-4ac8-8337-1c4dd50880f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.695157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ff60-ebfb-4ac8-8337-1c4dd50880f8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.695439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ff60-ebfb-4ac8-8337-1c4dd50880f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.695710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ff60-ebfb-4ac8-8337-1c4dd50880f8 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.696606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7ff60-ebfb-4ac8-8337-1c4dd50880f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:12.698583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7ff60-ebfb-4ac8-8337-1c4dd50880f8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:12.706389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 380/775] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 4 18:44:12 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:12.707218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ff60-ebfb-4ac8-8337-1c4dd50880f8 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.769714 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149c1fb-f499-4ff8-8f05-bffeef94712e None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.804530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eee0a-d836-49c7-b899-ca44be8872e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.805623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eee0a-d836-49c7-b899-ca44be8872e7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.806099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eee0a-d836-49c7-b899-ca44be8872e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.806574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eee0a-d836-49c7-b899-ca44be8872e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.807607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eee0a-d836-49c7-b899-ca44be8872e7 None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=86da4c4a11d74550aa59449b1bc5ca3d) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:12.808108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eee0a-d836-49c7-b899-ca44be8872e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:12.809774 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eee0a-d836-49c7-b899-ca44be8872e7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:12.816018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 396/776] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:12 2022] GET /identity/v3/role_assignments?user.id=86da4c4a11d74550aa59449b1bc5ca3d&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:12.825585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ff60-ebfb-4ac8-8337-1c4dd50880f8 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:12.864510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b89bc-822e-40ad-98a5-a1c422c03ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:12.865195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b89bc-822e-40ad-98a5-a1c422c03ffc None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.865503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b89bc-822e-40ad-98a5-a1c422c03ffc None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.865777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b89bc-822e-40ad-98a5-a1c422c03ffc None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.866600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b89bc-822e-40ad-98a5-a1c422c03ffc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:12.866860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b89bc-822e-40ad-98a5-a1c422c03ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:12.868292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b89bc-822e-40ad-98a5-a1c422c03ffc None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:12.878809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 381/777] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:12.884666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eee0a-d836-49c7-b899-ca44be8872e7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:12.897887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89193ba-5939-4ced-a3ba-a597cb65a7e5 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.898237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89193ba-5939-4ced-a3ba-a597cb65a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.898444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89193ba-5939-4ced-a3ba-a597cb65a7e5 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.900062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 382/778] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:12.906354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c56c1-13bf-41b2-bf65-f01b17041523 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:12.906692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c56c1-13bf-41b2-bf65-f01b17041523 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:12.906915 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c56c1-13bf-41b2-bf65-f01b17041523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:12.927686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-2b2c56c1-13bf-41b2-bf65-f01b17041523 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:12.929590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2b2c56c1-13bf-41b2-bf65-f01b17041523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:13.042262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 383/779] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:13.063047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eee0a-d836-49c7-b899-ca44be8872e7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:13.066772 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c56c1-13bf-41b2-bf65-f01b17041523 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:13.100480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398de0fd-e9ac-48a4-bbfd-d0f3ac1640a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:13.101305 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398de0fd-e9ac-48a4-bbfd-d0f3ac1640a9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:13.101605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398de0fd-e9ac-48a4-bbfd-d0f3ac1640a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:13.101861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398de0fd-e9ac-48a4-bbfd-d0f3ac1640a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:13.113268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398de0fd-e9ac-48a4-bbfd-d0f3ac1640a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:13.114752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398de0fd-e9ac-48a4-bbfd-d0f3ac1640a9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-398de0fd-e9ac-48a4-bbfd-d0f3ac1640a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:13.132351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:13.133307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:13.134463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:13.134463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:13.134463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:13.134463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:13.134463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 397/780] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:13.140256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398de0fd-e9ac-48a4-bbfd-d0f3ac1640a9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:13.197484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c56c1-13bf-41b2-bf65-f01b17041523 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:13.251982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d53d4-5606-4337-b80f-432c9b625781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:13.254500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d53d4-5606-4337-b80f-432c9b625781 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:13.254790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d53d4-5606-4337-b80f-432c9b625781 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:13.255069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d53d4-5606-4337-b80f-432c9b625781 None admin] PATH_INFO: `/v3/services/network` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:13.255740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d53d4-5606-4337-b80f-432c9b625781 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:13.257114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d53d4-5606-4337-b80f-432c9b625781 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-c19d53d4-5606-4337-b80f-432c9b625781 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:13.278745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:13.279791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:44:13.281221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:13.285726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 384/781] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:13 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:13.291465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d53d4-5606-4337-b80f-432c9b625781 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:13.296710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398de0fd-e9ac-48a4-bbfd-d0f3ac1640a9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:13.338481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628b8cb-7bdb-4068-b85d-bdc6d7bc2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:13.339153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628b8cb-7bdb-4068-b85d-bdc6d7bc2930 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:13.339435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628b8cb-7bdb-4068-b85d-bdc6d7bc2930 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:13.339711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628b8cb-7bdb-4068-b85d-bdc6d7bc2930 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:13.340447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628b8cb-7bdb-4068-b85d-bdc6d7bc2930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:13.340752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628b8cb-7bdb-4068-b85d-bdc6d7bc2930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:13.342843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628b8cb-7bdb-4068-b85d-bdc6d7bc2930 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:13.367009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 398/782] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:13.373943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628b8cb-7bdb-4068-b85d-bdc6d7bc2930 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:13.466798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d53d4-5606-4337-b80f-432c9b625781 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:13.530879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a81fb-ee8b-4dfb-b52b-f759a73489e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:13.532956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a81fb-ee8b-4dfb-b52b-f759a73489e7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:13.533240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a81fb-ee8b-4dfb-b52b-f759a73489e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:13.533540 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a81fb-ee8b-4dfb-b52b-f759a73489e7 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:13.534323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a81fb-ee8b-4dfb-b52b-f759a73489e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:13.534635 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a81fb-ee8b-4dfb-b52b-f759a73489e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:13.536044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a81fb-ee8b-4dfb-b52b-f759a73489e7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:13.545985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 385/783] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:13.549746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628b8cb-7bdb-4068-b85d-bdc6d7bc2930 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:13.552979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a81fb-ee8b-4dfb-b52b-f759a73489e7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:13.630353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa32d-1edc-451c-b096-18c11e26df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:13.631344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa32d-1edc-451c-b096-18c11e26df68 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:13.631715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa32d-1edc-451c-b096-18c11e26df68 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:13.632080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa32d-1edc-451c-b096-18c11e26df68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:13.650344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daa32d-1edc-451c-b096-18c11e26df68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:13.651910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daa32d-1edc-451c-b096-18c11e26df68 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:13.653561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a81fb-ee8b-4dfb-b52b-f759a73489e7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-01daa32d-1edc-451c-b096-18c11e26df68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:13.676101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:13.677326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:13.678520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:13.686399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da3459-7ace-46c3-9092-9ee75ade9166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:13.686556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 399/784] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 4 18:44:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:13.687119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da3459-7ace-46c3-9092-9ee75ade9166 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:13.687400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da3459-7ace-46c3-9092-9ee75ade9166 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:13.687736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da3459-7ace-46c3-9092-9ee75ade9166 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:13.688452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da3459-7ace-46c3-9092-9ee75ade9166 None admin] RBAC: Adding query filter params (type=network) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:13.688758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da3459-7ace-46c3-9092-9ee75ade9166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:13.690173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da3459-7ace-46c3-9092-9ee75ade9166 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:13.691986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa32d-1edc-451c-b096-18c11e26df68 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:13.695531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 386/785] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:13.702086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da3459-7ace-46c3-9092-9ee75ade9166 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:13.802390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da3459-7ace-46c3-9092-9ee75ade9166 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:13.835007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df40e75-4337-45f1-9199-f90832c3cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:13.835922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df40e75-4337-45f1-9199-f90832c3cf39 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:13.836285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df40e75-4337-45f1-9199-f90832c3cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:13.836652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df40e75-4337-45f1-9199-f90832c3cf39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:13.837600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df40e75-4337-45f1-9199-f90832c3cf39 None admin] RBAC: Adding query filter params (interface=public, service_id=426c0c6243b94a6f93fcd4d4020f08fb, region_id=RegionOne) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:13.838573 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df40e75-4337-45f1-9199-f90832c3cf39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:13.839852 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df40e75-4337-45f1-9199-f90832c3cf39 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:13.847956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 387/786] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 4 18:44:13 2022] GET /identity/v3/endpoints?service_id=426c0c6243b94a6f93fcd4d4020f08fb&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:13.853455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df40e75-4337-45f1-9199-f90832c3cf39 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:13.854428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa32d-1edc-451c-b096-18c11e26df68 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:13.915786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b846-2cd3-4817-a414-cc8a09b0a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:13.916771 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b846-2cd3-4817-a414-cc8a09b0a958 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:13.917226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b846-2cd3-4817-a414-cc8a09b0a958 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:13.918154 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b846-2cd3-4817-a414-cc8a09b0a958 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:13.919269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b846-2cd3-4817-a414-cc8a09b0a958 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:13.919741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b846-2cd3-4817-a414-cc8a09b0a958 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:13.921323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b846-2cd3-4817-a414-cc8a09b0a958 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:13.953989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df40e75-4337-45f1-9199-f90832c3cf39 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:13.955608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 400/787] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 4 18:44:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:13.961033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b846-2cd3-4817-a414-cc8a09b0a958 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:13.988134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa54be-253e-4613-8f07-ec4cad34be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:13.988957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa54be-253e-4613-8f07-ec4cad34be2e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:13.989238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa54be-253e-4613-8f07-ec4cad34be2e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:13.989530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa54be-253e-4613-8f07-ec4cad34be2e None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:13.990316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa54be-253e-4613-8f07-ec4cad34be2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:13.991727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa54be-253e-4613-8f07-ec4cad34be2e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:13.997140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 388/788] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 4 18:44:13 2022] GET /identity/v3/services => generated 772 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:14.145826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b846-2cd3-4817-a414-cc8a09b0a958 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:14.195550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d6dff-e945-440c-b970-9f5c08d96417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:14.196229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d6dff-e945-440c-b970-9f5c08d96417 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:14.196507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d6dff-e945-440c-b970-9f5c08d96417 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:14.196781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d6dff-e945-440c-b970-9f5c08d96417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:14.276466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d6dff-e945-440c-b970-9f5c08d96417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:14.277940 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d6dff-e945-440c-b970-9f5c08d96417 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:14.381509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 401/789] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:44:14.386840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa54be-253e-4613-8f07-ec4cad34be2e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:14.516960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa54be-253e-4613-8f07-ec4cad34be2e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:14.550114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e10d4-5b14-4c04-809a-d3b39a6beb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:14.550917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e10d4-5b14-4c04-809a-d3b39a6beb0c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:14.551198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e10d4-5b14-4c04-809a-d3b39a6beb0c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:14.551475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e10d4-5b14-4c04-809a-d3b39a6beb0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:14.562255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e10d4-5b14-4c04-809a-d3b39a6beb0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:14.563704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e10d4-5b14-4c04-809a-d3b39a6beb0c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-cf5e10d4-5b14-4c04-809a-d3b39a6beb0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:14.580738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:14.581728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:14.582642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:14.582642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:14.582642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:14.582642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:14.582642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 389/790] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:14.587457 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d6dff-e945-440c-b970-9f5c08d96417 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:14.740037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d6dff-e945-440c-b970-9f5c08d96417 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:14.783928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8202506-3ab3-4fac-ad9f-f325a00b9bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:14.784656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8202506-3ab3-4fac-ad9f-f325a00b9bcc None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:14.784943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8202506-3ab3-4fac-ad9f-f325a00b9bcc None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:14.785217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8202506-3ab3-4fac-ad9f-f325a00b9bcc None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:14.785975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8202506-3ab3-4fac-ad9f-f325a00b9bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:14.786280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8202506-3ab3-4fac-ad9f-f325a00b9bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:14.787643 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8202506-3ab3-4fac-ad9f-f325a00b9bcc None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:14.804880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 402/791] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:14.810737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e10d4-5b14-4c04-809a-d3b39a6beb0c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:14.916245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e10d4-5b14-4c04-809a-d3b39a6beb0c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:14.948884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16783d1-5785-4445-b2a1-5698852f59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:14.949731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16783d1-5785-4445-b2a1-5698852f59a7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:14.950001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16783d1-5785-4445-b2a1-5698852f59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:14.950274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16783d1-5785-4445-b2a1-5698852f59a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:14.957126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16783d1-5785-4445-b2a1-5698852f59a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:14.958593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16783d1-5785-4445-b2a1-5698852f59a7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-c16783d1-5785-4445-b2a1-5698852f59a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:14.973459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:14.974402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:14.975322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:14.975322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:14.975322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:14.975322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:14.975322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:14.975322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:14.975322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:14.975322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:14.975322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 390/792] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:14.980301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8202506-3ab3-4fac-ad9f-f325a00b9bcc None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:15.026650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b2402-df9a-48d3-b8eb-fa2be70c2b0c None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.026822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b2402-df9a-48d3-b8eb-fa2be70c2b0c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.027100 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b2402-df9a-48d3-b8eb-fa2be70c2b0c None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.028735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 391/793] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:15.033935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501913-703c-4bcd-8a4c-53a90b0e564d None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.034248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501913-703c-4bcd-8a4c-53a90b0e564d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.034514 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501913-703c-4bcd-8a4c-53a90b0e564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.051121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-cc501913-703c-4bcd-8a4c-53a90b0e564d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:15.052292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cc501913-703c-4bcd-8a4c-53a90b0e564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:15.112361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8202506-3ab3-4fac-ad9f-f325a00b9bcc None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:15.145665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9c25d-78da-4f1d-a307-f903397644d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:15.146384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9c25d-78da-4f1d-a307-f903397644d6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.146662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9c25d-78da-4f1d-a307-f903397644d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.146975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9c25d-78da-4f1d-a307-f903397644d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.147766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9c25d-78da-4f1d-a307-f903397644d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:15.148068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9c25d-78da-4f1d-a307-f903397644d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:15.149506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9c25d-78da-4f1d-a307-f903397644d6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:15.168398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 403/794] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:15.170114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9c25d-78da-4f1d-a307-f903397644d6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:15.192096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 392/795] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:15.233640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501913-703c-4bcd-8a4c-53a90b0e564d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:15.297919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9c25d-78da-4f1d-a307-f903397644d6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:15.354035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d77e5-dbd8-425f-b703-3b2bcb12c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:15.354695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d77e5-dbd8-425f-b703-3b2bcb12c5a8 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.354972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d77e5-dbd8-425f-b703-3b2bcb12c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.355243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d77e5-dbd8-425f-b703-3b2bcb12c5a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.356073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d77e5-dbd8-425f-b703-3b2bcb12c5a8 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=3938216005694c45bd6126415930d014) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:15.356379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d77e5-dbd8-425f-b703-3b2bcb12c5a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:15.357824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d77e5-dbd8-425f-b703-3b2bcb12c5a8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:15.373711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 404/796] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:15 2022] GET /identity/v3/role_assignments?user.id=3938216005694c45bd6126415930d014&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:15.379842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e1002-11c3-4c45-a788-8d5ea2eb59a1 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.380120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e1002-11c3-4c45-a788-8d5ea2eb59a1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.380396 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e1002-11c3-4c45-a788-8d5ea2eb59a1 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.382252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 405/797] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:15.403232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b12d5-99be-4e75-8674-6cfa739594b4 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.403546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b12d5-99be-4e75-8674-6cfa739594b4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.403769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b12d5-99be-4e75-8674-6cfa739594b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.432460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d81b12d5-99be-4e75-8674-6cfa739594b4 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:15.433799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d81b12d5-99be-4e75-8674-6cfa739594b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:15.456521 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501913-703c-4bcd-8a4c-53a90b0e564d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:15.524120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f23914-049c-4060-a5ce-d96b55b6c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:15.524941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f23914-049c-4060-a5ce-d96b55b6c8e6 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.525218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f23914-049c-4060-a5ce-d96b55b6c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.525510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f23914-049c-4060-a5ce-d96b55b6c8e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.543450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 406/798] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:15.545040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f23914-049c-4060-a5ce-d96b55b6c8e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-38f23914-049c-4060-a5ce-d96b55b6c8e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:15.552909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:15.553950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:15.554827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 393/799] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:15.562953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b12d5-99be-4e75-8674-6cfa739594b4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:15.583446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f23914-049c-4060-a5ce-d96b55b6c8e6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:15.677120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b12d5-99be-4e75-8674-6cfa739594b4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:15.709547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f23914-049c-4060-a5ce-d96b55b6c8e6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:15.712283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892937a-3e40-4bc6-9ad0-78e87c460fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:15.713188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892937a-3e40-4bc6-9ad0-78e87c460fcb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.713709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892937a-3e40-4bc6-9ad0-78e87c460fcb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.714297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892937a-3e40-4bc6-9ad0-78e87c460fcb None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.715273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892937a-3e40-4bc6-9ad0-78e87c460fcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:15.715779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892937a-3e40-4bc6-9ad0-78e87c460fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:15.717401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892937a-3e40-4bc6-9ad0-78e87c460fcb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:15.726438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 407/800] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:15.731630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892937a-3e40-4bc6-9ad0-78e87c460fcb None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:15.753915 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7addca1-63bc-461f-a1fc-806da3016156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:15.754733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7addca1-63bc-461f-a1fc-806da3016156 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.755008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7addca1-63bc-461f-a1fc-806da3016156 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.755278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7addca1-63bc-461f-a1fc-806da3016156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.772466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7addca1-63bc-461f-a1fc-806da3016156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-a7addca1-63bc-461f-a1fc-806da3016156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:15.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:15.781169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:15.782078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 394/801] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:44:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:15.789040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7addca1-63bc-461f-a1fc-806da3016156 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:15.852340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892937a-3e40-4bc6-9ad0-78e87c460fcb None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:15.902352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7b8d8-3a47-46a0-b815-e93737979d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:15.903467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7b8d8-3a47-46a0-b815-e93737979d5f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.903815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7b8d8-3a47-46a0-b815-e93737979d5f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.904179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7b8d8-3a47-46a0-b815-e93737979d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.910964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7addca1-63bc-461f-a1fc-806da3016156 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:15.917192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7b8d8-3a47-46a0-b815-e93737979d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:15.918755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7b8d8-3a47-46a0-b815-e93737979d5f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-e5a7b8d8-3a47-46a0-b815-e93737979d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:15.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:15.940709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:15.941628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:15.941628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:15.941628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:15.941628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:15.941628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 408/802] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:15.946947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a43255-d867-4d44-8ac8-f3d3050c0364 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.947235 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a43255-d867-4d44-8ac8-f3d3050c0364 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.947505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a43255-d867-4d44-8ac8-f3d3050c0364 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.948928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 409/803] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:15.949512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a43255-d867-4d44-8ac8-f3d3050c0364 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:15.955503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943f4d9-0158-4c18-970c-33875ece58db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:15.956574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943f4d9-0158-4c18-970c-33875ece58db None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.957060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943f4d9-0158-4c18-970c-33875ece58db None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.957575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943f4d9-0158-4c18-970c-33875ece58db None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.958536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943f4d9-0158-4c18-970c-33875ece58db None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:15.959029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943f4d9-0158-4c18-970c-33875ece58db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:15.960577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943f4d9-0158-4c18-970c-33875ece58db None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:15.969443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 395/804] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:44:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:15.971110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d342e4-f650-43d2-bc41-e2fc2b304fde None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:15.971729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d342e4-f650-43d2-bc41-e2fc2b304fde None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:15.972209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d342e4-f650-43d2-bc41-e2fc2b304fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:15.989484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-67d342e4-f650-43d2-bc41-e2fc2b304fde None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:15.991013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-67d342e4-f650-43d2-bc41-e2fc2b304fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:16.054229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a43255-d867-4d44-8ac8-f3d3050c0364 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.056997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 396/805] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:16.058199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d342e4-f650-43d2-bc41-e2fc2b304fde None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.086783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a338aa-c125-4436-9418-43a85ab47c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.087440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a338aa-c125-4436-9418-43a85ab47c98 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.087723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a338aa-c125-4436-9418-43a85ab47c98 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.087996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a338aa-c125-4436-9418-43a85ab47c98 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.088720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a338aa-c125-4436-9418-43a85ab47c98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:16.089024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a338aa-c125-4436-9418-43a85ab47c98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.090423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a338aa-c125-4436-9418-43a85ab47c98 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.102843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 410/806] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:16.107858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a338aa-c125-4436-9418-43a85ab47c98 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.160705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d342e4-f650-43d2-bc41-e2fc2b304fde None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.198228 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99e35e-8d99-4427-a04c-a8052d3c636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.199283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99e35e-8d99-4427-a04c-a8052d3c636b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.199725 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99e35e-8d99-4427-a04c-a8052d3c636b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.200132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99e35e-8d99-4427-a04c-a8052d3c636b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.207578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a338aa-c125-4436-9418-43a85ab47c98 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.210516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99e35e-8d99-4427-a04c-a8052d3c636b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.212125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99e35e-8d99-4427-a04c-a8052d3c636b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-6e99e35e-8d99-4427-a04c-a8052d3c636b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:16.229531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:16.230603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:16.231497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:16.231497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:16.231497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:16.231497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:16.233616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 397/807] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:16.234594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99e35e-8d99-4427-a04c-a8052d3c636b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.247146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530546e7-f292-4369-802c-87f1ee1c9f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.247950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530546e7-f292-4369-802c-87f1ee1c9f7f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.248230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530546e7-f292-4369-802c-87f1ee1c9f7f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.248552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530546e7-f292-4369-802c-87f1ee1c9f7f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.249160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530546e7-f292-4369-802c-87f1ee1c9f7f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.250864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530546e7-f292-4369-802c-87f1ee1c9f7f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-530546e7-f292-4369-802c-87f1ee1c9f7f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:16.263204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:16.264134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:16.264970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 411/808] 10.222.0.35 () {56 vars in 1129 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:16.265846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530546e7-f292-4369-802c-87f1ee1c9f7f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.335388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99e35e-8d99-4427-a04c-a8052d3c636b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.364136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530546e7-f292-4369-802c-87f1ee1c9f7f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.368841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033e671-efa8-4ceb-8e6f-e3cb53ed9634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.369856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033e671-efa8-4ceb-8e6f-e3cb53ed9634 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.370276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033e671-efa8-4ceb-8e6f-e3cb53ed9634 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.370686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033e671-efa8-4ceb-8e6f-e3cb53ed9634 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.378444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033e671-efa8-4ceb-8e6f-e3cb53ed9634 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.380057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033e671-efa8-4ceb-8e6f-e3cb53ed9634 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-b033e671-efa8-4ceb-8e6f-e3cb53ed9634 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:16.394601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:16.395750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:44:16.396899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:16.403901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 398/809] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:16.403901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033e671-efa8-4ceb-8e6f-e3cb53ed9634 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.405745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c69a-194c-4b90-a464-ed24e1e3c86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.406473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c69a-194c-4b90-a464-ed24e1e3c86b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.406872 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c69a-194c-4b90-a464-ed24e1e3c86b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.407058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c69a-194c-4b90-a464-ed24e1e3c86b None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.407851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c69a-194c-4b90-a464-ed24e1e3c86b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:16.409018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c69a-194c-4b90-a464-ed24e1e3c86b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.409668 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c69a-194c-4b90-a464-ed24e1e3c86b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.427492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 412/810] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:16.428356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c69a-194c-4b90-a464-ed24e1e3c86b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.502438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033e671-efa8-4ceb-8e6f-e3cb53ed9634 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.525379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c69a-194c-4b90-a464-ed24e1e3c86b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.536331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29599e61-d2c1-4f4c-8274-64d3cd4bdac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.537307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29599e61-d2c1-4f4c-8274-64d3cd4bdac1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.537784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29599e61-d2c1-4f4c-8274-64d3cd4bdac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.538297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29599e61-d2c1-4f4c-8274-64d3cd4bdac1 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.539211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29599e61-d2c1-4f4c-8274-64d3cd4bdac1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:16.539707 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29599e61-d2c1-4f4c-8274-64d3cd4bdac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.541239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29599e61-d2c1-4f4c-8274-64d3cd4bdac1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.545908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 399/811] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:16.546891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29599e61-d2c1-4f4c-8274-64d3cd4bdac1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.558869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb70b1-7974-457c-8b92-639f0eabe500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.559534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb70b1-7974-457c-8b92-639f0eabe500 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.559817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb70b1-7974-457c-8b92-639f0eabe500 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.560090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb70b1-7974-457c-8b92-639f0eabe500 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.560942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb70b1-7974-457c-8b92-639f0eabe500 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:16.561310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb70b1-7974-457c-8b92-639f0eabe500 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.562705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb70b1-7974-457c-8b92-639f0eabe500 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.586625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 413/812] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:16.586625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb70b1-7974-457c-8b92-639f0eabe500 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.666687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29599e61-d2c1-4f4c-8274-64d3cd4bdac1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.690204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb70b1-7974-457c-8b92-639f0eabe500 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.700525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5741d-084c-4ec2-8552-df94d6414b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.701760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5741d-084c-4ec2-8552-df94d6414b62 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.702234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5741d-084c-4ec2-8552-df94d6414b62 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.702695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5741d-084c-4ec2-8552-df94d6414b62 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.710363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5741d-084c-4ec2-8552-df94d6414b62 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.712071 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5741d-084c-4ec2-8552-df94d6414b62 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.725367 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372901c0-ed37-4b4c-9af8-217836833ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.726039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372901c0-ed37-4b4c-9af8-217836833ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.726320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372901c0-ed37-4b4c-9af8-217836833ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.726596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372901c0-ed37-4b4c-9af8-217836833ea7 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.727314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372901c0-ed37-4b4c-9af8-217836833ea7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:16.727676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372901c0-ed37-4b4c-9af8-217836833ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.729138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372901c0-ed37-4b4c-9af8-217836833ea7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-95d5741d-084c-4ec2-8552-df94d6414b62 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:16.729388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:16.730289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:16.731252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:16.733972 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 400/813] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:16.734976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5741d-084c-4ec2-8552-df94d6414b62 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.739547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 414/814] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:16.740276 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372901c0-ed37-4b4c-9af8-217836833ea7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.835666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5741d-084c-4ec2-8552-df94d6414b62 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.836916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372901c0-ed37-4b4c-9af8-217836833ea7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:16.868926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d347b1-e1be-4add-a5cf-a82db21dd93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.869747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d347b1-e1be-4add-a5cf-a82db21dd93f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.869854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed2bf8-2830-4aab-a57e-d4d378a5fbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:16.870303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d347b1-e1be-4add-a5cf-a82db21dd93f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.870303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d347b1-e1be-4add-a5cf-a82db21dd93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.870568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed2bf8-2830-4aab-a57e-d4d378a5fbff None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.870779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed2bf8-2830-4aab-a57e-d4d378a5fbff None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.871050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed2bf8-2830-4aab-a57e-d4d378a5fbff None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.871888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed2bf8-2830-4aab-a57e-d4d378a5fbff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:16.872195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed2bf8-2830-4aab-a57e-d4d378a5fbff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.873628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed2bf8-2830-4aab-a57e-d4d378a5fbff None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.880645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d347b1-e1be-4add-a5cf-a82db21dd93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:16.882099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d347b1-e1be-4add-a5cf-a82db21dd93f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:16.893640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 415/815] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:16.894645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed2bf8-2830-4aab-a57e-d4d378a5fbff None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-e4d347b1-e1be-4add-a5cf-a82db21dd93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:16.899439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:16.900509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:16.901513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:16.901513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:16.901513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:16.901513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:16.901513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 401/816] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:16.901846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7aeba-54bc-49c3-8960-694caa09903c None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:16.902126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7aeba-54bc-49c3-8960-694caa09903c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:16.902395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7aeba-54bc-49c3-8960-694caa09903c None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:16.907422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 402/817] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:16.907422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7aeba-54bc-49c3-8960-694caa09903c None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:16.994055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed2bf8-2830-4aab-a57e-d4d378a5fbff None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.004244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7aeba-54bc-49c3-8960-694caa09903c None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.026814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9928b-45c3-4853-94a1-2be6e6f4944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.027456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9928b-45c3-4853-94a1-2be6e6f4944c None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.027747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9928b-45c3-4853-94a1-2be6e6f4944c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.028019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9928b-45c3-4853-94a1-2be6e6f4944c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.028742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9928b-45c3-4853-94a1-2be6e6f4944c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.030148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9928b-45c3-4853-94a1-2be6e6f4944c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.036983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f95fe9-65c0-4e38-82e0-c3299bcf7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.037800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f95fe9-65c0-4e38-82e0-c3299bcf7b08 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.038074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f95fe9-65c0-4e38-82e0-c3299bcf7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.038341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f95fe9-65c0-4e38-82e0-c3299bcf7b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.048842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f95fe9-65c0-4e38-82e0-c3299bcf7b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.057330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 416/818] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 4 18:44:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:17.057564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f95fe9-65c0-4e38-82e0-c3299bcf7b08 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.057661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9928b-45c3-4853-94a1-2be6e6f4944c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-17f95fe9-65c0-4e38-82e0-c3299bcf7b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:17.077024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:17.078288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:17.079223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:17.079223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:17.079223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:17.079223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:17.079223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 403/819] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:17.079786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898983-14ac-4b33-8e5b-350f49d0d68f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.079892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898983-14ac-4b33-8e5b-350f49d0d68f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.080211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898983-14ac-4b33-8e5b-350f49d0d68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.098357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8e898983-14ac-4b33-8e5b-350f49d0d68f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:17.099537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8e898983-14ac-4b33-8e5b-350f49d0d68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:17.192325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 404/820] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:17.193114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9928b-45c3-4853-94a1-2be6e6f4944c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.193309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898983-14ac-4b33-8e5b-350f49d0d68f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.242004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e16ec4-96de-4711-92df-d8d33cc1a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.243072 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e16ec4-96de-4711-92df-d8d33cc1a64a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.243358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e16ec4-96de-4711-92df-d8d33cc1a64a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.243630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e16ec4-96de-4711-92df-d8d33cc1a64a None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.244737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e16ec4-96de-4711-92df-d8d33cc1a64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:17.244995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e16ec4-96de-4711-92df-d8d33cc1a64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.246752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e16ec4-96de-4711-92df-d8d33cc1a64a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.262286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 417/821] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:17.263165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e16ec4-96de-4711-92df-d8d33cc1a64a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.310605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898983-14ac-4b33-8e5b-350f49d0d68f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.345886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafb0ed-4b29-4d05-91b3-7f6dcdf37fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.346910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafb0ed-4b29-4d05-91b3-7f6dcdf37fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.346910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafb0ed-4b29-4d05-91b3-7f6dcdf37fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.347198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafb0ed-4b29-4d05-91b3-7f6dcdf37fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.347904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafb0ed-4b29-4d05-91b3-7f6dcdf37fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:17.348206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafb0ed-4b29-4d05-91b3-7f6dcdf37fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.350583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafb0ed-4b29-4d05-91b3-7f6dcdf37fa8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.368132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 405/822] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:17.369352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafb0ed-4b29-4d05-91b3-7f6dcdf37fa8 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.383820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e16ec4-96de-4711-92df-d8d33cc1a64a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.435565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438c83a-225c-4d34-90e7-41456cf84b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.437342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438c83a-225c-4d34-90e7-41456cf84b7a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.438141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438c83a-225c-4d34-90e7-41456cf84b7a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.438621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438c83a-225c-4d34-90e7-41456cf84b7a None admin] PATH_INFO: `/v3/services/network` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.439983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438c83a-225c-4d34-90e7-41456cf84b7a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.443361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438c83a-225c-4d34-90e7-41456cf84b7a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a438c83a-225c-4d34-90e7-41456cf84b7a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:17.457144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:17.458258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 18:44:17.459128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:17.462217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 418/823] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:17 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:17.467440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438c83a-225c-4d34-90e7-41456cf84b7a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.500620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafb0ed-4b29-4d05-91b3-7f6dcdf37fa8 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.534421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd720e5-9599-4ab3-965f-fa2c4a2475b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.535229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd720e5-9599-4ab3-965f-fa2c4a2475b7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.535505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd720e5-9599-4ab3-965f-fa2c4a2475b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.535779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd720e5-9599-4ab3-965f-fa2c4a2475b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.543073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd720e5-9599-4ab3-965f-fa2c4a2475b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.544534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd720e5-9599-4ab3-965f-fa2c4a2475b7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-ffd720e5-9599-4ab3-965f-fa2c4a2475b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:17.559605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:17.560575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:17.561512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:17.561512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:17.561512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:17.561512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:17.561512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:17.561512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:17.561512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:17.561512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:17.561512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 406/824] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:17.566751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd720e5-9599-4ab3-965f-fa2c4a2475b7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.590534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438c83a-225c-4d34-90e7-41456cf84b7a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.623996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c236aa3-6808-4c83-bf32-b7d7b197fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.625555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c236aa3-6808-4c83-bf32-b7d7b197fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.626076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c236aa3-6808-4c83-bf32-b7d7b197fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.626544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c236aa3-6808-4c83-bf32-b7d7b197fbd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.633582 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c236aa3-6808-4c83-bf32-b7d7b197fbd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.635265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c236aa3-6808-4c83-bf32-b7d7b197fbd3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-4c236aa3-6808-4c83-bf32-b7d7b197fbd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:17.649679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:17.650619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:17.651513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:17.651513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:17.651513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:17.651513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:17.651513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:17.651513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:17.651513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:17.651513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:17.660693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 419/825] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:17.662541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c236aa3-6808-4c83-bf32-b7d7b197fbd3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.664406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd720e5-9599-4ab3-965f-fa2c4a2475b7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.699311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344518bc-e559-4b03-bdaa-2ec1867ee62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.699630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344518bc-e559-4b03-bdaa-2ec1867ee62d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.699837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344518bc-e559-4b03-bdaa-2ec1867ee62d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.700111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344518bc-e559-4b03-bdaa-2ec1867ee62d None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.700827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344518bc-e559-4b03-bdaa-2ec1867ee62d None admin] RBAC: Adding query filter params (name=network) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:17.701132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344518bc-e559-4b03-bdaa-2ec1867ee62d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.702575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344518bc-e559-4b03-bdaa-2ec1867ee62d None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.711768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 407/826] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:17.711768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344518bc-e559-4b03-bdaa-2ec1867ee62d None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.777256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c236aa3-6808-4c83-bf32-b7d7b197fbd3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.818698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b347d-205c-4665-b649-8d6ce532e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.819955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b347d-205c-4665-b649-8d6ce532e128 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.820738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b347d-205c-4665-b649-8d6ce532e128 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.821239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b347d-205c-4665-b649-8d6ce532e128 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.822266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b347d-205c-4665-b649-8d6ce532e128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:17.823202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b347d-205c-4665-b649-8d6ce532e128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.825208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b347d-205c-4665-b649-8d6ce532e128 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.835932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344518bc-e559-4b03-bdaa-2ec1867ee62d None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.843379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 420/827] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:17.844704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b347d-205c-4665-b649-8d6ce532e128 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.881563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781c3c-2693-4a11-b682-19ac446a86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.882629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781c3c-2693-4a11-b682-19ac446a86f2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.883108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781c3c-2693-4a11-b682-19ac446a86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.884015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781c3c-2693-4a11-b682-19ac446a86f2 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.885020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4781c3c-2693-4a11-b682-19ac446a86f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:17.885945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4781c3c-2693-4a11-b682-19ac446a86f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.888230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4781c3c-2693-4a11-b682-19ac446a86f2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.911131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 408/828] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:17.911131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781c3c-2693-4a11-b682-19ac446a86f2 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:17.945089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b347d-205c-4665-b649-8d6ce532e128 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:17.977666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb254b-55d7-4db9-bdeb-a965db4faf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:17.978346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb254b-55d7-4db9-bdeb-a965db4faf4a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:17.978626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb254b-55d7-4db9-bdeb-a965db4faf4a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:17.978909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb254b-55d7-4db9-bdeb-a965db4faf4a None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:17.979619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb254b-55d7-4db9-bdeb-a965db4faf4a None admin] RBAC: Adding query filter params (type=network) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:17.979923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb254b-55d7-4db9-bdeb-a965db4faf4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:17.981307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb254b-55d7-4db9-bdeb-a965db4faf4a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:17.986141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 421/829] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:17.986884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb254b-55d7-4db9-bdeb-a965db4faf4a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:18.019992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781c3c-2693-4a11-b682-19ac446a86f2 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:18.052306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520b50f-a664-4be8-a2e7-e883788535be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:18.053201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b50f-a664-4be8-a2e7-e883788535be None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:18.053503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b50f-a664-4be8-a2e7-e883788535be None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:18.053781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b50f-a664-4be8-a2e7-e883788535be None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/d94a895e3a3547ff9cf35d808c595071/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:18.056170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520b50f-a664-4be8-a2e7-e883788535be None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=d94a895e3a3547ff9cf35d808c595071, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:18.057630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520b50f-a664-4be8-a2e7-e883788535be None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:18.081320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 409/830] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:44:17 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/d94a895e3a3547ff9cf35d808c595071/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:44:18.081320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348b8c0-70d0-498a-8194-ddd2d5bb7bc4 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:18.081320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348b8c0-70d0-498a-8194-ddd2d5bb7bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:18.081320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348b8c0-70d0-498a-8194-ddd2d5bb7bc4 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:18.081764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 410/831] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:18.082405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348b8c0-70d0-498a-8194-ddd2d5bb7bc4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:18.089843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb254b-55d7-4db9-bdeb-a965db4faf4a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:18.133639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786b139-578e-487c-a082-0db7bb720ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:18.134813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786b139-578e-487c-a082-0db7bb720ace None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:18.135205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786b139-578e-487c-a082-0db7bb720ace None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:18.135491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786b139-578e-487c-a082-0db7bb720ace None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/86da4c4a11d74550aa59449b1bc5ca3d/roles/b2763aed3ee84a9a9c5186ecada8844f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:18.155958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786b139-578e-487c-a082-0db7bb720ace None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=86da4c4a11d74550aa59449b1bc5ca3d, role_id=b2763aed3ee84a9a9c5186ecada8844f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:18.157951 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786b139-578e-487c-a082-0db7bb720ace None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:18.177373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 422/832] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:44:17 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/86da4c4a11d74550aa59449b1bc5ca3d/roles/b2763aed3ee84a9a9c5186ecada8844f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:44:18.181006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e314db2-5176-44d2-a73d-548c8b112002 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:18.181313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e314db2-5176-44d2-a73d-548c8b112002 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:18.181599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e314db2-5176-44d2-a73d-548c8b112002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:18.206320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5e314db2-5176-44d2-a73d-548c8b112002 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:18.207932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5e314db2-5176-44d2-a73d-548c8b112002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:18.225758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348b8c0-70d0-498a-8194-ddd2d5bb7bc4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:18.276298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7b461-8755-4880-925b-b66e58f4a078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:18.277274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7b461-8755-4880-925b-b66e58f4a078 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:18.277716 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7b461-8755-4880-925b-b66e58f4a078 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:18.282998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 423/833] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:18.283107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7b461-8755-4880-925b-b66e58f4a078 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:18.283107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7b461-8755-4880-925b-b66e58f4a078 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:18.284059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7b461-8755-4880-925b-b66e58f4a078 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:18.306248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e314db2-5176-44d2-a73d-548c8b112002 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:18.309605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 411/834] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 4 18:44:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:18.418627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e314db2-5176-44d2-a73d-548c8b112002 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:18.463591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584e5d4-1bcd-461e-b1f0-804efa24214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:18.464436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584e5d4-1bcd-461e-b1f0-804efa24214f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:18.464716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584e5d4-1bcd-461e-b1f0-804efa24214f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:18.464986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584e5d4-1bcd-461e-b1f0-804efa24214f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:18.465688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584e5d4-1bcd-461e-b1f0-804efa24214f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:18.467114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584e5d4-1bcd-461e-b1f0-804efa24214f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-8584e5d4-1bcd-461e-b1f0-804efa24214f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:18.480380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:18.481416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:18.482481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 424/835] 10.222.0.35 () {56 vars in 1132 bytes} [Wed May 4 18:44:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:18.490967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7b461-8755-4880-925b-b66e58f4a078 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:18.596960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7b461-8755-4880-925b-b66e58f4a078 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:18.630876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b29e-57ca-4993-bbed-6a9738367184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:18.631561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b29e-57ca-4993-bbed-6a9738367184 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:18.631840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b29e-57ca-4993-bbed-6a9738367184 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:18.632116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b29e-57ca-4993-bbed-6a9738367184 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:18.632838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4b29e-57ca-4993-bbed-6a9738367184 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:18.633143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4b29e-57ca-4993-bbed-6a9738367184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:18.634551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4b29e-57ca-4993-bbed-6a9738367184 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:18.639483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 412/836] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:18.645091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584e5d4-1bcd-461e-b1f0-804efa24214f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:18.756723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584e5d4-1bcd-461e-b1f0-804efa24214f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:18.794029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343eaf9-3c70-4c89-b7f3-fe8ab02e0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:18.795065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343eaf9-3c70-4c89-b7f3-fe8ab02e0be1 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:18.795590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343eaf9-3c70-4c89-b7f3-fe8ab02e0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:18.796053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343eaf9-3c70-4c89-b7f3-fe8ab02e0be1 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:18.796956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343eaf9-3c70-4c89-b7f3-fe8ab02e0be1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:18.797477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343eaf9-3c70-4c89-b7f3-fe8ab02e0be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:18.799037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343eaf9-3c70-4c89-b7f3-fe8ab02e0be1 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:18.807119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 425/837] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:19.449126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4738e60-cb18-4671-9af3-6356fe5f3167 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:19.449530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4738e60-cb18-4671-9af3-6356fe5f3167 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:19.449721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4738e60-cb18-4671-9af3-6356fe5f3167 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:19.451348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 413/838] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:19.462153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f1c4-843a-4342-81a4-abb62c499586 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:19.462671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f1c4-843a-4342-81a4-abb62c499586 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:19.462748 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f1c4-843a-4342-81a4-abb62c499586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:19.480625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-fe57f1c4-843a-4342-81a4-abb62c499586 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:19.481850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fe57f1c4-843a-4342-81a4-abb62c499586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:19.552076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 426/839] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:19.574262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4738e60-cb18-4671-9af3-6356fe5f3167 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:19.673867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4738e60-cb18-4671-9af3-6356fe5f3167 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:19.706577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2759c-59a7-4cda-af10-ed771f41972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:19.707365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2759c-59a7-4cda-af10-ed771f41972b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:19.707652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2759c-59a7-4cda-af10-ed771f41972b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:19.707927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2759c-59a7-4cda-af10-ed771f41972b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:19.708641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2759c-59a7-4cda-af10-ed771f41972b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:19.710037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2759c-59a7-4cda-af10-ed771f41972b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-dab2759c-59a7-4cda-af10-ed771f41972b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:19.722153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:19.723346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:19.724199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 414/840] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:44:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:19.729549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f1c4-843a-4342-81a4-abb62c499586 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:19.830184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f1c4-843a-4342-81a4-abb62c499586 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:19.864094 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1231b0-592e-4e12-99eb-b878e9e33d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:19.864809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1231b0-592e-4e12-99eb-b878e9e33d72 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:19.865096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1231b0-592e-4e12-99eb-b878e9e33d72 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:19.865400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1231b0-592e-4e12-99eb-b878e9e33d72 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:19.866119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1231b0-592e-4e12-99eb-b878e9e33d72 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:19.866433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1231b0-592e-4e12-99eb-b878e9e33d72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:19.867798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1231b0-592e-4e12-99eb-b878e9e33d72 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:19.872634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 427/841] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:44:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:19.878897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2759c-59a7-4cda-af10-ed771f41972b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:19.981418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2759c-59a7-4cda-af10-ed771f41972b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:20.014787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fc51b-762b-4092-a151-810acc9cda45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:20.015461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fc51b-762b-4092-a151-810acc9cda45 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:20.015740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fc51b-762b-4092-a151-810acc9cda45 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:20.016015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fc51b-762b-4092-a151-810acc9cda45 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:20.016732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fc51b-762b-4092-a151-810acc9cda45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:20.017040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fc51b-762b-4092-a151-810acc9cda45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:20.018531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fc51b-762b-4092-a151-810acc9cda45 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:20.023372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 415/842] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:44:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:20.606517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9386-3839-48ca-91e8-33781b4d93b6 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:20.607209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9386-3839-48ca-91e8-33781b4d93b6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:20.607209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9386-3839-48ca-91e8-33781b4d93b6 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:20.608688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 428/843] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:20.616104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eba4fe-a3f7-47b7-8269-32f486dc819b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:20.616104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eba4fe-a3f7-47b7-8269-32f486dc819b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:20.616104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eba4fe-a3f7-47b7-8269-32f486dc819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:20.633271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-93eba4fe-a3f7-47b7-8269-32f486dc819b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:20.634794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-93eba4fe-a3f7-47b7-8269-32f486dc819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:20.668838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059578-e47a-4ed8-a4c9-5bf8a2f2a4e6 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:20.669176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059578-e47a-4ed8-a4c9-5bf8a2f2a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:20.669434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059578-e47a-4ed8-a4c9-5bf8a2f2a4e6 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:20.671030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 429/844] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:20.676151 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06138-ed4a-4935-b5ea-df79fb6a6e77 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:20.676434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06138-ed4a-4935-b5ea-df79fb6a6e77 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:20.676711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06138-ed4a-4935-b5ea-df79fb6a6e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:20.696156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-eee06138-ed4a-4935-b5ea-df79fb6a6e77 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:20.697657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-eee06138-ed4a-4935-b5ea-df79fb6a6e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:20.703150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 416/845] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:20.733604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eba4fe-a3f7-47b7-8269-32f486dc819b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:20.771201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 430/846] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:20.796542 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee06138-ed4a-4935-b5ea-df79fb6a6e77 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:20.833374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eba4fe-a3f7-47b7-8269-32f486dc819b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:20.866717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c81059-0a70-4bf3-9355-1c012fa46f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:20.867532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c81059-0a70-4bf3-9355-1c012fa46f98 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:20.867814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c81059-0a70-4bf3-9355-1c012fa46f98 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:20.868087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c81059-0a70-4bf3-9355-1c012fa46f98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:20.880537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c81059-0a70-4bf3-9355-1c012fa46f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-43c81059-0a70-4bf3-9355-1c012fa46f98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:20.888570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:20.889628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:20.890472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 417/847] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:20.896555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c81059-0a70-4bf3-9355-1c012fa46f98 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:20.905502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee06138-ed4a-4935-b5ea-df79fb6a6e77 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:20.943341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a5070-54e6-4519-8aab-6a9ad5d540cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:20.944541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a5070-54e6-4519-8aab-6a9ad5d540cc None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:20.945029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a5070-54e6-4519-8aab-6a9ad5d540cc None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:20.945560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a5070-54e6-4519-8aab-6a9ad5d540cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:20.956799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a5070-54e6-4519-8aab-6a9ad5d540cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-449a5070-54e6-4519-8aab-6a9ad5d540cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:20.968760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:20.969988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:44:20.970844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:20.973571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 431/848] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:20.979058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a5070-54e6-4519-8aab-6a9ad5d540cc None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.009863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c81059-0a70-4bf3-9355-1c012fa46f98 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.044632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e674-3c4b-4f8f-8b69-fb41b54d8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.045710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e674-3c4b-4f8f-8b69-fb41b54d8624 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.046219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e674-3c4b-4f8f-8b69-fb41b54d8624 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.046730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e674-3c4b-4f8f-8b69-fb41b54d8624 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.047698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e674-3c4b-4f8f-8b69-fb41b54d8624 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:21.048276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e674-3c4b-4f8f-8b69-fb41b54d8624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.050006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e674-3c4b-4f8f-8b69-fb41b54d8624 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.063682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 418/849] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:21.066006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e674-3c4b-4f8f-8b69-fb41b54d8624 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.097839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a5070-54e6-4519-8aab-6a9ad5d540cc None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.131302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a956410-3e97-4a17-ad9a-b7cb18742264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.133386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a956410-3e97-4a17-ad9a-b7cb18742264 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.133895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a956410-3e97-4a17-ad9a-b7cb18742264 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.134377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a956410-3e97-4a17-ad9a-b7cb18742264 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.135215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a956410-3e97-4a17-ad9a-b7cb18742264 None admin] RBAC: Adding query filter params (name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:21.135526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a956410-3e97-4a17-ad9a-b7cb18742264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.136896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a956410-3e97-4a17-ad9a-b7cb18742264 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.149663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 432/850] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:21.149663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cea7c0-0a61-471b-b4a8-911c3eb5e72f None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.149663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cea7c0-0a61-471b-b4a8-911c3eb5e72f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.149663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cea7c0-0a61-471b-b4a8-911c3eb5e72f None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.149663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 433/851] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:21.151656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cea7c0-0a61-471b-b4a8-911c3eb5e72f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.173096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e674-3c4b-4f8f-8b69-fb41b54d8624 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.210805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2f644-64b3-45e6-a877-7c65dca271a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.211622 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2f644-64b3-45e6-a877-7c65dca271a5 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.211903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2f644-64b3-45e6-a877-7c65dca271a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.212184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2f644-64b3-45e6-a877-7c65dca271a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.223377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2f644-64b3-45e6-a877-7c65dca271a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.224832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2f644-64b3-45e6-a877-7c65dca271a5 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-d5d2f644-64b3-45e6-a877-7c65dca271a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:21.241921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:21.242875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:21.243774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:21.243774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:21.243774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:21.243774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:21.243774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 419/852] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:21.244749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2d51-64f3-4ea7-b289-2c66f0cf40dc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.245028 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2d51-64f3-4ea7-b289-2c66f0cf40dc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.245370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2d51-64f3-4ea7-b289-2c66f0cf40dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.257449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cea7c0-0a61-471b-b4a8-911c3eb5e72f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.262800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-135c2d51-64f3-4ea7-b289-2c66f0cf40dc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:21.263916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-135c2d51-64f3-4ea7-b289-2c66f0cf40dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:21.291385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7cf68-fcae-4e71-9ef4-56e779b0596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.292495 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7cf68-fcae-4e71-9ef4-56e779b0596e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.292780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7cf68-fcae-4e71-9ef4-56e779b0596e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.293057 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7cf68-fcae-4e71-9ef4-56e779b0596e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.303276 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7cf68-fcae-4e71-9ef4-56e779b0596e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.304719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7cf68-fcae-4e71-9ef4-56e779b0596e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-4ec7cf68-fcae-4e71-9ef4-56e779b0596e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:21.326876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:21.328393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:21.330626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:21.330626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:21.330626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:21.330626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:21.330939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 420/853] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:21.330939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c2d51-64f3-4ea7-b289-2c66f0cf40dc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.338329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 434/854] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:21.342605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7cf68-fcae-4e71-9ef4-56e779b0596e None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.434621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c2d51-64f3-4ea7-b289-2c66f0cf40dc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.445031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7cf68-fcae-4e71-9ef4-56e779b0596e None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.475536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35be90-e902-4356-a1bd-1526da6b0df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.476359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35be90-e902-4356-a1bd-1526da6b0df9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.476638 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35be90-e902-4356-a1bd-1526da6b0df9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.477209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35be90-e902-4356-a1bd-1526da6b0df9 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.478237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35be90-e902-4356-a1bd-1526da6b0df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:21.478547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35be90-e902-4356-a1bd-1526da6b0df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.479907 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35be90-e902-4356-a1bd-1526da6b0df9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.481440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12a0df-da9c-4f9e-8e47-dfcc30a889c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.482101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a0df-da9c-4f9e-8e47-dfcc30a889c2 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.482379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a0df-da9c-4f9e-8e47-dfcc30a889c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.482660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a0df-da9c-4f9e-8e47-dfcc30a889c2 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.483368 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12a0df-da9c-4f9e-8e47-dfcc30a889c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:21.483671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12a0df-da9c-4f9e-8e47-dfcc30a889c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.485014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12a0df-da9c-4f9e-8e47-dfcc30a889c2 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.500362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 421/855] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:21.500535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 435/856] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:21.501688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35be90-e902-4356-a1bd-1526da6b0df9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.501904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12a0df-da9c-4f9e-8e47-dfcc30a889c2 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.598474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35be90-e902-4356-a1bd-1526da6b0df9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.611293 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12a0df-da9c-4f9e-8e47-dfcc30a889c2 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.631791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e49d77-c0f7-4607-b5ee-21404b8e320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.632457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e49d77-c0f7-4607-b5ee-21404b8e320b None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.632737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e49d77-c0f7-4607-b5ee-21404b8e320b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.633009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e49d77-c0f7-4607-b5ee-21404b8e320b None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.633770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e49d77-c0f7-4607-b5ee-21404b8e320b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.635125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e49d77-c0f7-4607-b5ee-21404b8e320b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.650150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444c2f-0b44-4420-bd2a-f3070d4da6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.650951 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444c2f-0b44-4420-bd2a-f3070d4da6cb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.651231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444c2f-0b44-4420-bd2a-f3070d4da6cb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.651500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444c2f-0b44-4420-bd2a-f3070d4da6cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.661742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 422/857] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:44:21 2022] POST /identity/v3/services => generated 269 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:21.661742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e49d77-c0f7-4607-b5ee-21404b8e320b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.662147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444c2f-0b44-4420-bd2a-f3070d4da6cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.662147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444c2f-0b44-4420-bd2a-f3070d4da6cb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-67444c2f-0b44-4420-bd2a-f3070d4da6cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:21.676379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:21.677476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:21.678413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 436/858] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:21.685665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444c2f-0b44-4420-bd2a-f3070d4da6cb None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.777797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e49d77-c0f7-4607-b5ee-21404b8e320b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.792160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444c2f-0b44-4420-bd2a-f3070d4da6cb None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.814560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246ba09-d0cf-438a-874a-293699082f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.815991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246ba09-d0cf-438a-874a-293699082f77 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.816479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246ba09-d0cf-438a-874a-293699082f77 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.816944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246ba09-d0cf-438a-874a-293699082f77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.825916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246ba09-d0cf-438a-874a-293699082f77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.827738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246ba09-d0cf-438a-874a-293699082f77 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.836205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1b7c9-a4fa-4f2b-a88b-f79b598b29bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:21.836885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1b7c9-a4fa-4f2b-a88b-f79b598b29bf None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:21.837227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1b7c9-a4fa-4f2b-a88b-f79b598b29bf None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:21.837553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1b7c9-a4fa-4f2b-a88b-f79b598b29bf None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:21.838466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1b7c9-a4fa-4f2b-a88b-f79b598b29bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:21.838778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1b7c9-a4fa-4f2b-a88b-f79b598b29bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:21.840557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1b7c9-a4fa-4f2b-a88b-f79b598b29bf None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-c246ba09-d0cf-438a-874a-293699082f77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:21.845339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:21.846345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:21.847284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:21.850140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 423/859] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:44:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:21.857871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246ba09-d0cf-438a-874a-293699082f77 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.862347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 437/860] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 4 18:44:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:21.867536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1b7c9-a4fa-4f2b-a88b-f79b598b29bf None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:21.965498 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246ba09-d0cf-438a-874a-293699082f77 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:21.982223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1b7c9-a4fa-4f2b-a88b-f79b598b29bf None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:22.002395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddb2ae-cf24-46da-8f50-4a7778ddeddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.003139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddb2ae-cf24-46da-8f50-4a7778ddeddd None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.003418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddb2ae-cf24-46da-8f50-4a7778ddeddd None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.003691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddb2ae-cf24-46da-8f50-4a7778ddeddd None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.004541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddb2ae-cf24-46da-8f50-4a7778ddeddd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:22.004851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddb2ae-cf24-46da-8f50-4a7778ddeddd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:22.006320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddb2ae-cf24-46da-8f50-4a7778ddeddd None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:22.024433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 424/861] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 4 18:44:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:22.028997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85545df2-ee55-4682-bbcd-298a11f3189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.029876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddb2ae-cf24-46da-8f50-4a7778ddeddd None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:22.030136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85545df2-ee55-4682-bbcd-298a11f3189a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.030590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85545df2-ee55-4682-bbcd-298a11f3189a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.031044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85545df2-ee55-4682-bbcd-298a11f3189a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.109165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85545df2-ee55-4682-bbcd-298a11f3189a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:22.110648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85545df2-ee55-4682-bbcd-298a11f3189a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:22.154947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddb2ae-cf24-46da-8f50-4a7778ddeddd None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:22.199726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988764ec-3c25-46f6-b716-689b8dba807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.200538 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988764ec-3c25-46f6-b716-689b8dba807d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.201100 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988764ec-3c25-46f6-b716-689b8dba807d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.201409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988764ec-3c25-46f6-b716-689b8dba807d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.219830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 438/862] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:21 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:44:22.225223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85545df2-ee55-4682-bbcd-298a11f3189a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:22.288472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988764ec-3c25-46f6-b716-689b8dba807d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:22.290270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988764ec-3c25-46f6-b716-689b8dba807d None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:22.320967 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85545df2-ee55-4682-bbcd-298a11f3189a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:22.353596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35c31-8d84-4d0b-b76d-7bcf2fd67a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.354396 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35c31-8d84-4d0b-b76d-7bcf2fd67a74 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.354677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35c31-8d84-4d0b-b76d-7bcf2fd67a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.354950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35c31-8d84-4d0b-b76d-7bcf2fd67a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.364699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b35c31-8d84-4d0b-b76d-7bcf2fd67a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:22.366121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b35c31-8d84-4d0b-b76d-7bcf2fd67a74 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a2b35c31-8d84-4d0b-b76d-7bcf2fd67a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:22.383487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:22.384431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:22.385484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:22.385484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:22.385484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:22.385484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:22.385484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 439/863] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:22.386279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf941d-d365-45e4-a87b-5a09a2ad6de3 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.386386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf941d-d365-45e4-a87b-5a09a2ad6de3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.386827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf941d-d365-45e4-a87b-5a09a2ad6de3 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.388065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 440/864] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:22.392608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf941d-d365-45e4-a87b-5a09a2ad6de3 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:22.397371 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 425/865] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:22 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:44:22.397371 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2cfb0-4acb-4f2e-9750-18aae8afe7bd None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.397371 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2cfb0-4acb-4f2e-9750-18aae8afe7bd None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.397371 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2cfb0-4acb-4f2e-9750-18aae8afe7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.412305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7ce2cfb0-4acb-4f2e-9750-18aae8afe7bd None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:22.413515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7ce2cfb0-4acb-4f2e-9750-18aae8afe7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:22.476650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 426/866] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:22 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:22.482166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2cfb0-4acb-4f2e-9750-18aae8afe7bd None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:22.504597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf941d-d365-45e4-a87b-5a09a2ad6de3 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:22.537479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7ddb-1092-4221-93df-2ce83526f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.538151 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7ddb-1092-4221-93df-2ce83526f846 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.538430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7ddb-1092-4221-93df-2ce83526f846 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.538701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7ddb-1092-4221-93df-2ce83526f846 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.539428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa7ddb-1092-4221-93df-2ce83526f846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:22.539735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa7ddb-1092-4221-93df-2ce83526f846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:22.541112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa7ddb-1092-4221-93df-2ce83526f846 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:22.556329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 441/867] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:22.556329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7ddb-1092-4221-93df-2ce83526f846 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:22.585951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2cfb0-4acb-4f2e-9750-18aae8afe7bd None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:22.617469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88c21b-f9fc-4824-9798-7489d42f3987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.618195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88c21b-f9fc-4824-9798-7489d42f3987 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.618471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88c21b-f9fc-4824-9798-7489d42f3987 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.618739 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88c21b-f9fc-4824-9798-7489d42f3987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.628884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88c21b-f9fc-4824-9798-7489d42f3987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:22.630512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88c21b-f9fc-4824-9798-7489d42f3987 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:22.645770 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7ddb-1092-4221-93df-2ce83526f846 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8e88c21b-f9fc-4824-9798-7489d42f3987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:22.647444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:22.648306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:22.649873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:22.649873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:22.649873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:22.649873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:22.649873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 427/868] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:22.649873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88c21b-f9fc-4824-9798-7489d42f3987 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:22.681616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb670d9-6485-4295-9534-1da4db3404b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.682290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb670d9-6485-4295-9534-1da4db3404b9 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.682569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb670d9-6485-4295-9534-1da4db3404b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.682845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb670d9-6485-4295-9534-1da4db3404b9 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.683563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb670d9-6485-4295-9534-1da4db3404b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:22.684921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb670d9-6485-4295-9534-1da4db3404b9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:22.708704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 442/869] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:44:22 2022] POST /identity/v3/services => generated 251 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:22.708704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb670d9-6485-4295-9534-1da4db3404b9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:22.751610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88c21b-f9fc-4824-9798-7489d42f3987 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:22.794068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652225d-72c0-4c6b-917b-d9e82d519e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.794934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652225d-72c0-4c6b-917b-d9e82d519e33 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.795235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652225d-72c0-4c6b-917b-d9e82d519e33 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.795419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652225d-72c0-4c6b-917b-d9e82d519e33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.803385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652225d-72c0-4c6b-917b-d9e82d519e33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:22.804939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652225d-72c0-4c6b-917b-d9e82d519e33 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:22.809882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb670d9-6485-4295-9534-1da4db3404b9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-f652225d-72c0-4c6b-917b-d9e82d519e33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:22.819884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:22.820841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:22.821976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:22.821976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:22.821976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:22.821976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:22.821976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:22.821976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:22.821976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:22.821976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:22.821976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 428/870] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:22.828474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652225d-72c0-4c6b-917b-d9e82d519e33 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:22.850315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79243e96-2728-496b-a858-ddb6375a9118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.852910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79243e96-2728-496b-a858-ddb6375a9118 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.853512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79243e96-2728-496b-a858-ddb6375a9118 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.853999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79243e96-2728-496b-a858-ddb6375a9118 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.854961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79243e96-2728-496b-a858-ddb6375a9118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:22.855483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79243e96-2728-496b-a858-ddb6375a9118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:22.857159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79243e96-2728-496b-a858-ddb6375a9118 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:22.871899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 443/871] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:22.877931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79243e96-2728-496b-a858-ddb6375a9118 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:22.952882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652225d-72c0-4c6b-917b-d9e82d519e33 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:22.995462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b800e1-3101-441f-8c8e-ea10900de1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:22.996526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b800e1-3101-441f-8c8e-ea10900de1cc None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:22.996877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b800e1-3101-441f-8c8e-ea10900de1cc None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:22.997218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b800e1-3101-441f-8c8e-ea10900de1cc None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:22.998349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b800e1-3101-441f-8c8e-ea10900de1cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:22.998883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b800e1-3101-441f-8c8e-ea10900de1cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:23.001450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b800e1-3101-441f-8c8e-ea10900de1cc None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:23.003227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79243e96-2728-496b-a858-ddb6375a9118 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:23.024138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 429/872] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:23.026992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b800e1-3101-441f-8c8e-ea10900de1cc None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:23.050646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57525b52-a691-4e46-b9cc-4a6cfe89aaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:23.051608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57525b52-a691-4e46-b9cc-4a6cfe89aaba None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:23.051893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57525b52-a691-4e46-b9cc-4a6cfe89aaba None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:23.052167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57525b52-a691-4e46-b9cc-4a6cfe89aaba None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:23.060936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57525b52-a691-4e46-b9cc-4a6cfe89aaba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:23.063345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57525b52-a691-4e46-b9cc-4a6cfe89aaba None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-57525b52-a691-4e46-b9cc-4a6cfe89aaba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:23.079646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:23.080579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:23.082291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:23.082291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:23.082291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:23.082291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:23.082291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:23.082291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:23.082291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:23.082291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:23.082291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 444/873] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:23.086516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57525b52-a691-4e46-b9cc-4a6cfe89aaba None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:23.136083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b800e1-3101-441f-8c8e-ea10900de1cc None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:23.182207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72fc89-3b1e-4c81-9535-285f3ac13f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:23.183497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72fc89-3b1e-4c81-9535-285f3ac13f25 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:23.184146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72fc89-3b1e-4c81-9535-285f3ac13f25 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:23.184882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72fc89-3b1e-4c81-9535-285f3ac13f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:23.186018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72fc89-3b1e-4c81-9535-285f3ac13f25 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=d94a895e3a3547ff9cf35d808c595071) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:23.186545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72fc89-3b1e-4c81-9535-285f3ac13f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:23.188600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72fc89-3b1e-4c81-9535-285f3ac13f25 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:23.205320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57525b52-a691-4e46-b9cc-4a6cfe89aaba None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:23.206171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 430/874] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:23 2022] GET /identity/v3/role_assignments?user.id=d94a895e3a3547ff9cf35d808c595071&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:23.235874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa19e32-17b0-4a9d-aee2-356c78eb5247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:23.236547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19e32-17b0-4a9d-aee2-356c78eb5247 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:23.236825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19e32-17b0-4a9d-aee2-356c78eb5247 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:23.237166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19e32-17b0-4a9d-aee2-356c78eb5247 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:23.237996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19e32-17b0-4a9d-aee2-356c78eb5247 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:23.238305 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19e32-17b0-4a9d-aee2-356c78eb5247 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:23.239765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19e32-17b0-4a9d-aee2-356c78eb5247 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:23.253646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 445/875] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:23.259455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72fc89-3b1e-4c81-9535-285f3ac13f25 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:23.369065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72fc89-3b1e-4c81-9535-285f3ac13f25 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:23.406831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a9eab-e96f-46a6-977c-107b45cb0ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:23.407837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a9eab-e96f-46a6-977c-107b45cb0ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:23.408336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a9eab-e96f-46a6-977c-107b45cb0ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:23.408849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a9eab-e96f-46a6-977c-107b45cb0ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:23.409931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a9eab-e96f-46a6-977c-107b45cb0ba4 None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=86da4c4a11d74550aa59449b1bc5ca3d) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:23.410493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a9eab-e96f-46a6-977c-107b45cb0ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:23.412147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a9eab-e96f-46a6-977c-107b45cb0ba4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:23.420548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 431/876] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:23 2022] GET /identity/v3/role_assignments?user.id=86da4c4a11d74550aa59449b1bc5ca3d&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:23.980815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d04705-94a7-4cee-ac76-8434300d7dc5 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:23.981404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d04705-94a7-4cee-ac76-8434300d7dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:23.981404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d04705-94a7-4cee-ac76-8434300d7dc5 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:23.982861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 446/877] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:23.988214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614ce05-727e-462c-bd64-17a4c6b50aa3 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:23.988615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614ce05-727e-462c-bd64-17a4c6b50aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:23.988783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614ce05-727e-462c-bd64-17a4c6b50aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:24.005776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a614ce05-727e-462c-bd64-17a4c6b50aa3 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:24.007001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a614ce05-727e-462c-bd64-17a4c6b50aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:24.071785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 432/878] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:24.094232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d04705-94a7-4cee-ac76-8434300d7dc5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:24.191289 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d04705-94a7-4cee-ac76-8434300d7dc5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:24.225106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c8bce-2022-4fd5-b008-4fe31c27013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:24.225939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c8bce-2022-4fd5-b008-4fe31c27013b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:24.226216 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c8bce-2022-4fd5-b008-4fe31c27013b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:24.226487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c8bce-2022-4fd5-b008-4fe31c27013b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:24.227138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c8bce-2022-4fd5-b008-4fe31c27013b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:24.228491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c8bce-2022-4fd5-b008-4fe31c27013b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-3f6c8bce-2022-4fd5-b008-4fe31c27013b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:24.240491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:24.241471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:24.242314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 447/879] 10.222.0.35 () {56 vars in 1132 bytes} [Wed May 4 18:44:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:24.250072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614ce05-727e-462c-bd64-17a4c6b50aa3 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:24.348437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614ce05-727e-462c-bd64-17a4c6b50aa3 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:24.383070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36f415-5ef5-45d4-84f6-654d8c785597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:24.384170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f415-5ef5-45d4-84f6-654d8c785597 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:24.384653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f415-5ef5-45d4-84f6-654d8c785597 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:24.385142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f415-5ef5-45d4-84f6-654d8c785597 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:24.386231 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36f415-5ef5-45d4-84f6-654d8c785597 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:24.386763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36f415-5ef5-45d4-84f6-654d8c785597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:24.388372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36f415-5ef5-45d4-84f6-654d8c785597 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:24.394791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 433/880] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:24.401104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c8bce-2022-4fd5-b008-4fe31c27013b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:24.506672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c8bce-2022-4fd5-b008-4fe31c27013b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:24.539121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0d03-51bc-46b8-83cd-ba6477a315d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:24.539788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0d03-51bc-46b8-83cd-ba6477a315d0 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:24.540064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0d03-51bc-46b8-83cd-ba6477a315d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:24.540335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0d03-51bc-46b8-83cd-ba6477a315d0 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:24.541045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0d03-51bc-46b8-83cd-ba6477a315d0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:24.541372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0d03-51bc-46b8-83cd-ba6477a315d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:24.542732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0d03-51bc-46b8-83cd-ba6477a315d0 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:24.547992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 448/881] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:24.553873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36f415-5ef5-45d4-84f6-654d8c785597 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:24.654117 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36f415-5ef5-45d4-84f6-654d8c785597 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:24.687694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3b35e-6661-4115-8549-3577b06a70eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:24.688693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3b35e-6661-4115-8549-3577b06a70eb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:24.689194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3b35e-6661-4115-8549-3577b06a70eb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:24.689741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3b35e-6661-4115-8549-3577b06a70eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:24.690748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3b35e-6661-4115-8549-3577b06a70eb None admin] RBAC: Adding query filter params (interface=public, service_id=188ea33b4d7941f6a158f8e9a533c877, region_id=RegionOne) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:24.691272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3b35e-6661-4115-8549-3577b06a70eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:24.692835 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3b35e-6661-4115-8549-3577b06a70eb None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:24.698494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 434/882] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 4 18:44:24 2022] GET /identity/v3/endpoints?service_id=188ea33b4d7941f6a158f8e9a533c877&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:24.704134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0d03-51bc-46b8-83cd-ba6477a315d0 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:24.805114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0d03-51bc-46b8-83cd-ba6477a315d0 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:24.837132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71de176-367a-466f-b6d7-9b367a9b0bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:24.837831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de176-367a-466f-b6d7-9b367a9b0bf8 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:24.838106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de176-367a-466f-b6d7-9b367a9b0bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:24.838374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de176-367a-466f-b6d7-9b367a9b0bf8 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:24.839052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71de176-367a-466f-b6d7-9b367a9b0bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:24.840430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71de176-367a-466f-b6d7-9b367a9b0bf8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:24.846353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 449/883] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 4 18:44:24 2022] GET /identity/v3/services => generated 1268 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:44:25.093297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d40c-f6bc-4c34-a454-bd4599a24913 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.093805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d40c-f6bc-4c34-a454-bd4599a24913 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.093805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d40c-f6bc-4c34-a454-bd4599a24913 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.095348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 435/884] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:25.100704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27987bfe-b187-45a9-af83-cbb19cb39aa5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.101162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27987bfe-b187-45a9-af83-cbb19cb39aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.101241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27987bfe-b187-45a9-af83-cbb19cb39aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.117858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-27987bfe-b187-45a9-af83-cbb19cb39aa5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:25.119022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-27987bfe-b187-45a9-af83-cbb19cb39aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:25.184716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 450/885] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:25.207716 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d40c-f6bc-4c34-a454-bd4599a24913 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:25.306826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d40c-f6bc-4c34-a454-bd4599a24913 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:25.343435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4db6f-c644-4b3e-8804-10b8db68f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:25.344632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4db6f-c644-4b3e-8804-10b8db68f741 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.345187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4db6f-c644-4b3e-8804-10b8db68f741 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.345694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4db6f-c644-4b3e-8804-10b8db68f741 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.346843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4db6f-c644-4b3e-8804-10b8db68f741 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:25.348463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4db6f-c644-4b3e-8804-10b8db68f741 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-05d4db6f-c644-4b3e-8804-10b8db68f741 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:25.361236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:25.362410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:44:25.363232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:25.366174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 436/886] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:44:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:25.372229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27987bfe-b187-45a9-af83-cbb19cb39aa5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:25.470445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27987bfe-b187-45a9-af83-cbb19cb39aa5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:25.503826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41aa81-8115-4aa0-9437-5fff66bbbc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:25.504550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41aa81-8115-4aa0-9437-5fff66bbbc33 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.504822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41aa81-8115-4aa0-9437-5fff66bbbc33 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.505088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41aa81-8115-4aa0-9437-5fff66bbbc33 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.505822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41aa81-8115-4aa0-9437-5fff66bbbc33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:25.506122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41aa81-8115-4aa0-9437-5fff66bbbc33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:25.507526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41aa81-8115-4aa0-9437-5fff66bbbc33 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:25.512405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 451/887] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:44:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:25.518061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4db6f-c644-4b3e-8804-10b8db68f741 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:25.531754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c607-1ea7-4a62-8985-5cb43ada8e34 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.532091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c607-1ea7-4a62-8985-5cb43ada8e34 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.532369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c607-1ea7-4a62-8985-5cb43ada8e34 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.534039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 452/888] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:25.538900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6ee0-759c-4e5f-8a13-736349416926 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.539179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6ee0-759c-4e5f-8a13-736349416926 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.539466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6ee0-759c-4e5f-8a13-736349416926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.555971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9f3d6ee0-759c-4e5f-8a13-736349416926 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:25.557157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9f3d6ee0-759c-4e5f-8a13-736349416926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:25.627511 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 453/889] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:25.632987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4db6f-c644-4b3e-8804-10b8db68f741 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:25.649128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d6ee0-759c-4e5f-8a13-736349416926 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:25.667669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d523a0-4e99-4424-97e6-5c265d2dffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:25.668349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d523a0-4e99-4424-97e6-5c265d2dffad None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.668622 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d523a0-4e99-4424-97e6-5c265d2dffad None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.668893 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d523a0-4e99-4424-97e6-5c265d2dffad None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.669637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d523a0-4e99-4424-97e6-5c265d2dffad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:25.669931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d523a0-4e99-4424-97e6-5c265d2dffad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:25.671326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d523a0-4e99-4424-97e6-5c265d2dffad None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:25.676692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 437/890] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:44:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:25.686824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d523a0-4e99-4424-97e6-5c265d2dffad None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:25.754236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d6ee0-759c-4e5f-8a13-736349416926 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:25.783454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d523a0-4e99-4424-97e6-5c265d2dffad None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:25.788378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ecc24-c9af-4d93-90f8-a9d3893e6006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:25.789178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ecc24-c9af-4d93-90f8-a9d3893e6006 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.789491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ecc24-c9af-4d93-90f8-a9d3893e6006 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.789761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ecc24-c9af-4d93-90f8-a9d3893e6006 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.790410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ecc24-c9af-4d93-90f8-a9d3893e6006 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:25.791773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ecc24-c9af-4d93-90f8-a9d3893e6006 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-f04ecc24-c9af-4d93-90f8-a9d3893e6006 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:25.803374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:25.804380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:25.805244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 454/891] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:25.806096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400dc0-1296-4f73-aaad-7e42616a7959 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.806096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400dc0-1296-4f73-aaad-7e42616a7959 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.806809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400dc0-1296-4f73-aaad-7e42616a7959 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.809952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 455/892] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:25.810722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400dc0-1296-4f73-aaad-7e42616a7959 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:25.823876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4346fc0-22c9-4e59-9157-0499e4419dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:25.824544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4346fc0-22c9-4e59-9157-0499e4419dae None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.824820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4346fc0-22c9-4e59-9157-0499e4419dae None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.825092 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4346fc0-22c9-4e59-9157-0499e4419dae None admin] PATH_INFO: `/v3/endpoints` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.825961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4346fc0-22c9-4e59-9157-0499e4419dae None admin] RBAC: Adding query filter params (interface=public, service_id=163edaae720e4bddb4fe366113fd9d1e, region_id=RegionOne) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:25.826287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4346fc0-22c9-4e59-9157-0499e4419dae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:25.827633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4346fc0-22c9-4e59-9157-0499e4419dae None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:25.836810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 438/893] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 4 18:44:25 2022] GET /identity/v3/endpoints?service_id=163edaae720e4bddb4fe366113fd9d1e&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:25.836810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c15a83-cfce-426d-b99b-77e15c45a3ea None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.836810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c15a83-cfce-426d-b99b-77e15c45a3ea None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.836810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c15a83-cfce-426d-b99b-77e15c45a3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.850633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-80c15a83-cfce-426d-b99b-77e15c45a3ea None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:25.851807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-80c15a83-cfce-426d-b99b-77e15c45a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:25.911659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400dc0-1296-4f73-aaad-7e42616a7959 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:25.914179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 439/894] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:25.915001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c15a83-cfce-426d-b99b-77e15c45a3ea None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:25.956922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b609170-7580-4059-938b-b4e1f48e49ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:25.957618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b609170-7580-4059-938b-b4e1f48e49ed None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:25.957895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b609170-7580-4059-938b-b4e1f48e49ed None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:25.958162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b609170-7580-4059-938b-b4e1f48e49ed None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:25.958891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b609170-7580-4059-938b-b4e1f48e49ed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:25.959199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b609170-7580-4059-938b-b4e1f48e49ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:25.960553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b609170-7580-4059-938b-b4e1f48e49ed None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:25.965804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 456/895] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:25.966567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b609170-7580-4059-938b-b4e1f48e49ed None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:26.019143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c15a83-cfce-426d-b99b-77e15c45a3ea None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:26.053039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691045d-c0e4-4816-8137-9f2cd054e247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:26.053767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691045d-c0e4-4816-8137-9f2cd054e247 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:26.054044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691045d-c0e4-4816-8137-9f2cd054e247 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:26.054323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691045d-c0e4-4816-8137-9f2cd054e247 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:26.055026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691045d-c0e4-4816-8137-9f2cd054e247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:26.056451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691045d-c0e4-4816-8137-9f2cd054e247 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:26.062436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 440/896] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 4 18:44:25 2022] GET /identity/v3/services => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:44:26.063234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691045d-c0e4-4816-8137-9f2cd054e247 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:26.078957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b609170-7580-4059-938b-b4e1f48e49ed None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:26.115486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0d32d-c543-40f9-a250-5d7163e170a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:26.116313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d32d-c543-40f9-a250-5d7163e170a8 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:26.116592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d32d-c543-40f9-a250-5d7163e170a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:26.116864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d32d-c543-40f9-a250-5d7163e170a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:26.128921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0d32d-c543-40f9-a250-5d7163e170a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-48e0d32d-c543-40f9-a250-5d7163e170a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:26.137672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:26.138720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:26.139557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 457/897] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 4 18:44:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:26.148286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0d32d-c543-40f9-a250-5d7163e170a8 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:26.188768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691045d-c0e4-4816-8137-9f2cd054e247 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:26.233660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781e8b-cdd9-483d-b20a-4abee02899c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:26.234600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781e8b-cdd9-483d-b20a-4abee02899c0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:26.235047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781e8b-cdd9-483d-b20a-4abee02899c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:26.235478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781e8b-cdd9-483d-b20a-4abee02899c0 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:26.236341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781e8b-cdd9-483d-b20a-4abee02899c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:26.236820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781e8b-cdd9-483d-b20a-4abee02899c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:26.238418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781e8b-cdd9-483d-b20a-4abee02899c0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:26.243817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 441/898] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:26.257310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0d32d-c543-40f9-a250-5d7163e170a8 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:26.300154 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedbc00-af36-4553-a8bc-8bd2e56dccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:26.300835 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedbc00-af36-4553-a8bc-8bd2e56dccec None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:26.301118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedbc00-af36-4553-a8bc-8bd2e56dccec None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:26.301494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedbc00-af36-4553-a8bc-8bd2e56dccec None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:26.302265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedbc00-af36-4553-a8bc-8bd2e56dccec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:26.302570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedbc00-af36-4553-a8bc-8bd2e56dccec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:26.303954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedbc00-af36-4553-a8bc-8bd2e56dccec None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:26.317506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 458/899] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 4 18:44:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:26.322667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781e8b-cdd9-483d-b20a-4abee02899c0 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:26.428437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781e8b-cdd9-483d-b20a-4abee02899c0 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:26.469370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befafde0-f030-4f9b-a3f1-b2dea0f9b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:26.470482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befafde0-f030-4f9b-a3f1-b2dea0f9b756 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:26.470973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befafde0-f030-4f9b-a3f1-b2dea0f9b756 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:26.471564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befafde0-f030-4f9b-a3f1-b2dea0f9b756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:26.481744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befafde0-f030-4f9b-a3f1-b2dea0f9b756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:26.483370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befafde0-f030-4f9b-a3f1-b2dea0f9b756 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-befafde0-f030-4f9b-a3f1-b2dea0f9b756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:26.501971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:26.503261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:26.504367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:26.504367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:26.504367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:26.504367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:26.510095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 442/900] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:26.512259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedbc00-af36-4553-a8bc-8bd2e56dccec None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:26.608147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedbc00-af36-4553-a8bc-8bd2e56dccec None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:26.642676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a782a2e-34be-4594-b7d5-77e5f3177914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:26.643430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a782a2e-34be-4594-b7d5-77e5f3177914 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:26.643713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a782a2e-34be-4594-b7d5-77e5f3177914 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:26.643983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a782a2e-34be-4594-b7d5-77e5f3177914 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:26.644757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a782a2e-34be-4594-b7d5-77e5f3177914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:26.645064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a782a2e-34be-4594-b7d5-77e5f3177914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:26.646464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a782a2e-34be-4594-b7d5-77e5f3177914 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:26.658386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 459/901] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:26.664074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befafde0-f030-4f9b-a3f1-b2dea0f9b756 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:26.759964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befafde0-f030-4f9b-a3f1-b2dea0f9b756 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:26.793421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aed25-c912-448f-b70e-8ff4003214e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:26.794577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aed25-c912-448f-b70e-8ff4003214e2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:26.795047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aed25-c912-448f-b70e-8ff4003214e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:26.795547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aed25-c912-448f-b70e-8ff4003214e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:26.802938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aed25-c912-448f-b70e-8ff4003214e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:26.804645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aed25-c912-448f-b70e-8ff4003214e2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-cd9aed25-c912-448f-b70e-8ff4003214e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:26.819980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:26.820948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:26.821940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:26.827861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 443/902] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:44:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:26.830597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a782a2e-34be-4594-b7d5-77e5f3177914 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:26.930904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a782a2e-34be-4594-b7d5-77e5f3177914 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:26.964025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6803232-c4ec-4cb6-ba88-fa2400f22a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:26.964703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6803232-c4ec-4cb6-ba88-fa2400f22a9b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:26.964981 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6803232-c4ec-4cb6-ba88-fa2400f22a9b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:26.965254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6803232-c4ec-4cb6-ba88-fa2400f22a9b None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:26.966125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6803232-c4ec-4cb6-ba88-fa2400f22a9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:26.966439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6803232-c4ec-4cb6-ba88-fa2400f22a9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:26.967859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6803232-c4ec-4cb6-ba88-fa2400f22a9b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:26.985494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 460/903] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 4 18:44:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:26.991710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aed25-c912-448f-b70e-8ff4003214e2 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:27.096002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aed25-c912-448f-b70e-8ff4003214e2 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:27.130673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce33b0-0559-4c57-b5a2-b7330ed2b5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:27.131332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce33b0-0559-4c57-b5a2-b7330ed2b5bb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.131612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce33b0-0559-4c57-b5a2-b7330ed2b5bb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.131886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce33b0-0559-4c57-b5a2-b7330ed2b5bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.198115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7cf62-794d-466b-a463-74cb9a675095 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.198642 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7cf62-794d-466b-a463-74cb9a675095 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.198642 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7cf62-794d-466b-a463-74cb9a675095 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.200234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 461/904] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:27.205213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc024d-a6cd-405c-af53-1fa83e9923fc None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.205595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc024d-a6cd-405c-af53-1fa83e9923fc None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.205897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc024d-a6cd-405c-af53-1fa83e9923fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.209419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce33b0-0559-4c57-b5a2-b7330ed2b5bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:27.211548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce33b0-0559-4c57-b5a2-b7330ed2b5bb None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:27.222486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-56cc024d-a6cd-405c-af53-1fa83e9923fc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:27.223674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-56cc024d-a6cd-405c-af53-1fa83e9923fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:27.297642 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 462/905] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:27.316232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc024d-a6cd-405c-af53-1fa83e9923fc None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:27.316732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 444/906] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:26 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:44:27.318132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce33b0-0559-4c57-b5a2-b7330ed2b5bb None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:27.419024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc024d-a6cd-405c-af53-1fa83e9923fc None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:27.434485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce33b0-0559-4c57-b5a2-b7330ed2b5bb None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:27.456703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb73da-f940-47c8-ad86-3ac9e26a8b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:27.456703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb73da-f940-47c8-ad86-3ac9e26a8b46 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.456703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb73da-f940-47c8-ad86-3ac9e26a8b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.456703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb73da-f940-47c8-ad86-3ac9e26a8b46 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.457141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb73da-f940-47c8-ad86-3ac9e26a8b46 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:27.458346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb73da-f940-47c8-ad86-3ac9e26a8b46 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a2cb73da-f940-47c8-ad86-3ac9e26a8b46 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:27.471318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:27.472355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 18:44:27.473193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:27.477857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 463/907] 10.222.0.35 () {56 vars in 1132 bytes} [Wed May 4 18:44:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:27.478488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb73da-f940-47c8-ad86-3ac9e26a8b46 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:27.488838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d9b9c-ae40-44b4-9cb1-1f9e9757d65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:27.489734 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d9b9c-ae40-44b4-9cb1-1f9e9757d65a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.490014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d9b9c-ae40-44b4-9cb1-1f9e9757d65a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.490284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d9b9c-ae40-44b4-9cb1-1f9e9757d65a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.503769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d9b9c-ae40-44b4-9cb1-1f9e9757d65a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:27.505617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d9b9c-ae40-44b4-9cb1-1f9e9757d65a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-097d9b9c-ae40-44b4-9cb1-1f9e9757d65a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:27.528778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:27.529721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:27.530619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:27.530619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:27.530619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:27.530619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:27.533417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 445/908] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:27.535698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d9b9c-ae40-44b4-9cb1-1f9e9757d65a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:27.596366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb73da-f940-47c8-ad86-3ac9e26a8b46 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:27.637125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a9b59-20c6-4d23-adec-7a6b9b9fc95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:27.637822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9b59-20c6-4d23-adec-7a6b9b9fc95f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.638096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9b59-20c6-4d23-adec-7a6b9b9fc95f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.638364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9b59-20c6-4d23-adec-7a6b9b9fc95f None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.639236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a9b59-20c6-4d23-adec-7a6b9b9fc95f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:27.639539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a9b59-20c6-4d23-adec-7a6b9b9fc95f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:27.641541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a9b59-20c6-4d23-adec-7a6b9b9fc95f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:27.647867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 464/909] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:27.648688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d9b9c-ae40-44b4-9cb1-1f9e9757d65a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:27.653017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a9b59-20c6-4d23-adec-7a6b9b9fc95f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:27.685119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e3aa1-bd82-4c3e-bc7d-aa51d9bc3e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:27.685736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e3aa1-bd82-4c3e-bc7d-aa51d9bc3e1b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.686012 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e3aa1-bd82-4c3e-bc7d-aa51d9bc3e1b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.686286 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e3aa1-bd82-4c3e-bc7d-aa51d9bc3e1b None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.687021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e3aa1-bd82-4c3e-bc7d-aa51d9bc3e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:27.687291 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e3aa1-bd82-4c3e-bc7d-aa51d9bc3e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:27.688637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e3aa1-bd82-4c3e-bc7d-aa51d9bc3e1b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:27.708156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 446/910] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:27.709278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e3aa1-bd82-4c3e-bc7d-aa51d9bc3e1b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:27.768922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a9b59-20c6-4d23-adec-7a6b9b9fc95f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:27.802886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb31d3a-8255-420b-8ba1-cfe300bb1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:27.803834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb31d3a-8255-420b-8ba1-cfe300bb1bda None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.804079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb31d3a-8255-420b-8ba1-cfe300bb1bda None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.804492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb31d3a-8255-420b-8ba1-cfe300bb1bda None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.805316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb31d3a-8255-420b-8ba1-cfe300bb1bda None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:27.805753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb31d3a-8255-420b-8ba1-cfe300bb1bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:27.807206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb31d3a-8255-420b-8ba1-cfe300bb1bda None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:27.812676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 465/911] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:27.819025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb31d3a-8255-420b-8ba1-cfe300bb1bda None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:27.830869 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e3aa1-bd82-4c3e-bc7d-aa51d9bc3e1b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:27.864544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9482-a71d-4847-a799-9a482de3593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:27.865438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9482-a71d-4847-a799-9a482de3593c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.865728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9482-a71d-4847-a799-9a482de3593c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.865989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9482-a71d-4847-a799-9a482de3593c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.874462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af9482-a71d-4847-a799-9a482de3593c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:27.876366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af9482-a71d-4847-a799-9a482de3593c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-b8af9482-a71d-4847-a799-9a482de3593c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:27.894516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:27.895468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:27.896801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:27.896801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:27.896801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:27.896801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:27.896801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:27.896801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:27.896801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:27.896801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:27.896801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 447/912] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:27.901824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9482-a71d-4847-a799-9a482de3593c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:27.934773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb31d3a-8255-420b-8ba1-cfe300bb1bda None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:27.968871 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe74c66-b6db-4aa4-a533-427a4700ccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:27.969530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe74c66-b6db-4aa4-a533-427a4700ccf7 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:27.969810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe74c66-b6db-4aa4-a533-427a4700ccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:27.970084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe74c66-b6db-4aa4-a533-427a4700ccf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:27.970904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe74c66-b6db-4aa4-a533-427a4700ccf7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:27.972415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe74c66-b6db-4aa4-a533-427a4700ccf7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:27.994864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 466/913] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 4 18:44:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:44:28.033125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9482-a71d-4847-a799-9a482de3593c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:28.077376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d690213-e705-4035-a027-18d98b6306a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:28.078157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d690213-e705-4035-a027-18d98b6306a0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:28.078440 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d690213-e705-4035-a027-18d98b6306a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:28.078765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d690213-e705-4035-a027-18d98b6306a0 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:28.079577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d690213-e705-4035-a027-18d98b6306a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:28.079888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d690213-e705-4035-a027-18d98b6306a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:28.081402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d690213-e705-4035-a027-18d98b6306a0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:28.095139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 448/914] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:28.101088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe74c66-b6db-4aa4-a533-427a4700ccf7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:28.219780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe74c66-b6db-4aa4-a533-427a4700ccf7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:28.254400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd5a60-ecee-4968-920f-1a6a728553bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:28.255065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd5a60-ecee-4968-920f-1a6a728553bb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:28.255340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd5a60-ecee-4968-920f-1a6a728553bb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:28.255608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd5a60-ecee-4968-920f-1a6a728553bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:28.256442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd5a60-ecee-4968-920f-1a6a728553bb None admin] RBAC: Adding query filter params (role.id=a6441f8a929f4bcd82b2c8fc4402e2f1, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=86da4c4a11d74550aa59449b1bc5ca3d) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:28.256748 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd5a60-ecee-4968-920f-1a6a728553bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:28.258199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd5a60-ecee-4968-920f-1a6a728553bb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:28.263958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 467/915] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:28 2022] GET /identity/v3/role_assignments?user.id=86da4c4a11d74550aa59449b1bc5ca3d&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=a6441f8a929f4bcd82b2c8fc4402e2f1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:28.395925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9077488-9c71-4380-8eab-f4a14d886b58 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:28.396461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9077488-9c71-4380-8eab-f4a14d886b58 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:28.396461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9077488-9c71-4380-8eab-f4a14d886b58 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:28.398182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 449/916] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:28.403937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39173a-52d4-42a1-9524-ac72aead6d36 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:28.404573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39173a-52d4-42a1-9524-ac72aead6d36 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:28.405364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39173a-52d4-42a1-9524-ac72aead6d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:28.424572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-bb39173a-52d4-42a1-9524-ac72aead6d36 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:28.426439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-bb39173a-52d4-42a1-9524-ac72aead6d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:28.507868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 468/917] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:28.527243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9077488-9c71-4380-8eab-f4a14d886b58 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:28.623403 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f539-fee6-4176-a3a1-377430bac2d4 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:28.624708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f539-fee6-4176-a3a1-377430bac2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:28.625196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f539-fee6-4176-a3a1-377430bac2d4 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:28.627780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 469/918] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:28.632889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27174eb-8a2b-48e5-afb2-c4ae2d6f1640 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:28.633447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27174eb-8a2b-48e5-afb2-c4ae2d6f1640 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:28.633935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27174eb-8a2b-48e5-afb2-c4ae2d6f1640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:28.634056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9077488-9c71-4380-8eab-f4a14d886b58 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:28.650909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e27174eb-8a2b-48e5-afb2-c4ae2d6f1640 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:28.652408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e27174eb-8a2b-48e5-afb2-c4ae2d6f1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:28.672644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730cad-1b25-40d7-8776-a6591d149564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:28.673722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730cad-1b25-40d7-8776-a6591d149564 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:28.674005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730cad-1b25-40d7-8776-a6591d149564 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:28.674378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730cad-1b25-40d7-8776-a6591d149564 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:28.675038 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04730cad-1b25-40d7-8776-a6591d149564 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:28.676864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04730cad-1b25-40d7-8776-a6591d149564 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-04730cad-1b25-40d7-8776-a6591d149564 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:28.691363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:28.692459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 18:44:28.693405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:28.697369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 450/919] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:44:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:28.700620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730cad-1b25-40d7-8776-a6591d149564 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:28.729425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 470/920] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:28.747297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27174eb-8a2b-48e5-afb2-c4ae2d6f1640 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:28.824020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730cad-1b25-40d7-8776-a6591d149564 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:28.852684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27174eb-8a2b-48e5-afb2-c4ae2d6f1640 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:28.864406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1263a2-ae1a-48b2-9505-f6ea43cc03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:28.865081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1263a2-ae1a-48b2-9505-f6ea43cc03f4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:28.865413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1263a2-ae1a-48b2-9505-f6ea43cc03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:28.865687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1263a2-ae1a-48b2-9505-f6ea43cc03f4 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:28.866425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1263a2-ae1a-48b2-9505-f6ea43cc03f4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:28.866905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1263a2-ae1a-48b2-9505-f6ea43cc03f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:28.868077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1263a2-ae1a-48b2-9505-f6ea43cc03f4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:28.873329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 451/921] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:44:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:28.880593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1263a2-ae1a-48b2-9505-f6ea43cc03f4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:28.898998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437e517-5358-4a5d-96fa-a528d629c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:28.900034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437e517-5358-4a5d-96fa-a528d629c033 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:28.900513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437e517-5358-4a5d-96fa-a528d629c033 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:28.900994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437e517-5358-4a5d-96fa-a528d629c033 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:28.902025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437e517-5358-4a5d-96fa-a528d629c033 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:28.903687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437e517-5358-4a5d-96fa-a528d629c033 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:28.926173 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 471/922] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:44:28 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:28.996451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1263a2-ae1a-48b2-9505-f6ea43cc03f4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:29.041058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6bcc4-5f68-407c-bca9-4713afeb0330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:29.042200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6bcc4-5f68-407c-bca9-4713afeb0330 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:29.042717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6bcc4-5f68-407c-bca9-4713afeb0330 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:29.043206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6bcc4-5f68-407c-bca9-4713afeb0330 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:29.044146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6bcc4-5f68-407c-bca9-4713afeb0330 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:29.044651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6bcc4-5f68-407c-bca9-4713afeb0330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:29.046336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6bcc4-5f68-407c-bca9-4713afeb0330 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:29.052682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 452/923] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 4 18:44:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:29.058464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437e517-5358-4a5d-96fa-a528d629c033 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:29.178093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437e517-5358-4a5d-96fa-a528d629c033 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:29.217630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773a686-85f5-427c-bb4c-476ba1093cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:29.218329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a686-85f5-427c-bb4c-476ba1093cff None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:29.218610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a686-85f5-427c-bb4c-476ba1093cff None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:29.218884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a686-85f5-427c-bb4c-476ba1093cff None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:29.219662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a686-85f5-427c-bb4c-476ba1093cff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:29.221112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a686-85f5-427c-bb4c-476ba1093cff None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:29.249606 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 472/924] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 4 18:44:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:30.321954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4acd0-ddf7-4d8d-97ff-d7da7a1c205a None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:30.322546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4acd0-ddf7-4d8d-97ff-d7da7a1c205a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:30.322546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4acd0-ddf7-4d8d-97ff-d7da7a1c205a None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:30.324074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 453/925] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:30.329521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714fb8-214f-437e-8bc7-dd79fb63f6e2 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:30.330354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714fb8-214f-437e-8bc7-dd79fb63f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:30.330887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714fb8-214f-437e-8bc7-dd79fb63f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:30.349434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-71714fb8-214f-437e-8bc7-dd79fb63f6e2 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:30.351077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-71714fb8-214f-437e-8bc7-dd79fb63f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:30.429267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 473/926] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:30.451788 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4acd0-ddf7-4d8d-97ff-d7da7a1c205a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:30.540769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220fdb5-24d9-445c-8590-f82b39aaa975 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:30.541464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220fdb5-24d9-445c-8590-f82b39aaa975 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:30.541971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220fdb5-24d9-445c-8590-f82b39aaa975 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:30.543775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 474/927] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:30.548966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204c2ef-0b87-4747-90e6-1581f4b1e1a5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:30.549585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204c2ef-0b87-4747-90e6-1581f4b1e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:30.550074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204c2ef-0b87-4747-90e6-1581f4b1e1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:30.551321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4acd0-ddf7-4d8d-97ff-d7da7a1c205a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:30.567976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a204c2ef-0b87-4747-90e6-1581f4b1e1a5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:30.569829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a204c2ef-0b87-4747-90e6-1581f4b1e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:30.584598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0cdec-9f34-4f69-905c-f8cdbe6ba5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:30.585370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0cdec-9f34-4f69-905c-f8cdbe6ba5c4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:30.585650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0cdec-9f34-4f69-905c-f8cdbe6ba5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:30.585921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0cdec-9f34-4f69-905c-f8cdbe6ba5c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:30.586590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0cdec-9f34-4f69-905c-f8cdbe6ba5c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:30.588053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0cdec-9f34-4f69-905c-f8cdbe6ba5c4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-a2c0cdec-9f34-4f69-905c-f8cdbe6ba5c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:30.602848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:30.603892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:30.604738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 454/928] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:30.610026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0cdec-9f34-4f69-905c-f8cdbe6ba5c4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:30.652894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 475/929] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:30.674719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204c2ef-0b87-4747-90e6-1581f4b1e1a5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:30.729324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0cdec-9f34-4f69-905c-f8cdbe6ba5c4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:30.771737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21118-5bc7-4ed9-a0b5-12c3edfbcf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:30.772500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21118-5bc7-4ed9-a0b5-12c3edfbcf5f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:30.772845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21118-5bc7-4ed9-a0b5-12c3edfbcf5f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:30.773268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21118-5bc7-4ed9-a0b5-12c3edfbcf5f None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:30.774044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21118-5bc7-4ed9-a0b5-12c3edfbcf5f None admin] RBAC: Adding query filter params (name=compute) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:30.774232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21118-5bc7-4ed9-a0b5-12c3edfbcf5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:30.775578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21118-5bc7-4ed9-a0b5-12c3edfbcf5f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:30.784455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 455/930] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:30.789393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21118-5bc7-4ed9-a0b5-12c3edfbcf5f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:30.792623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204c2ef-0b87-4747-90e6-1581f4b1e1a5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:30.827346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dea9ab-6410-4ee2-8300-d11ce73add1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:30.828190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dea9ab-6410-4ee2-8300-d11ce73add1c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:30.828467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dea9ab-6410-4ee2-8300-d11ce73add1c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:30.828737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dea9ab-6410-4ee2-8300-d11ce73add1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:30.842300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dea9ab-6410-4ee2-8300-d11ce73add1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a2dea9ab-6410-4ee2-8300-d11ce73add1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:30.850596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:30.851629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:30.853610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:30.856855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 476/931] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 4 18:44:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:30.857747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dea9ab-6410-4ee2-8300-d11ce73add1c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:30.910775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21118-5bc7-4ed9-a0b5-12c3edfbcf5f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:30.944406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532a6c-24d4-4776-b3cd-2f7e86e599b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:30.945108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532a6c-24d4-4776-b3cd-2f7e86e599b5 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:30.945425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532a6c-24d4-4776-b3cd-2f7e86e599b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:30.945700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532a6c-24d4-4776-b3cd-2f7e86e599b5 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:30.946416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532a6c-24d4-4776-b3cd-2f7e86e599b5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:30.946720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532a6c-24d4-4776-b3cd-2f7e86e599b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:30.948513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532a6c-24d4-4776-b3cd-2f7e86e599b5 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:30.952812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 456/932] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:30.983098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dea9ab-6410-4ee2-8300-d11ce73add1c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:31.021786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce702d8-5318-4caf-a774-8a760d2b5315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:31.022747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce702d8-5318-4caf-a774-8a760d2b5315 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.023209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce702d8-5318-4caf-a774-8a760d2b5315 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.023637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce702d8-5318-4caf-a774-8a760d2b5315 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.024572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce702d8-5318-4caf-a774-8a760d2b5315 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:31.025030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce702d8-5318-4caf-a774-8a760d2b5315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:31.026660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce702d8-5318-4caf-a774-8a760d2b5315 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:31.038982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 477/933] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 4 18:44:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:31.047695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532a6c-24d4-4776-b3cd-2f7e86e599b5 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:31.165754 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532a6c-24d4-4776-b3cd-2f7e86e599b5 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:31.206637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123370ce-c7c4-4663-b070-2b222d6bd44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:31.207828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123370ce-c7c4-4663-b070-2b222d6bd44e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.208347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123370ce-c7c4-4663-b070-2b222d6bd44e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.208763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123370ce-c7c4-4663-b070-2b222d6bd44e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.220121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123370ce-c7c4-4663-b070-2b222d6bd44e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:31.221918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123370ce-c7c4-4663-b070-2b222d6bd44e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-123370ce-c7c4-4663-b070-2b222d6bd44e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:31.239875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:31.241056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:31.242255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:31.242255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:31.242255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:31.242255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:31.244248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 457/934] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:31.250523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce702d8-5318-4caf-a774-8a760d2b5315 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:31.347052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce702d8-5318-4caf-a774-8a760d2b5315 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:31.357598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09b8a-8ef3-4446-8f09-f70715eb2210 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.358647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09b8a-8ef3-4446-8f09-f70715eb2210 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.359128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09b8a-8ef3-4446-8f09-f70715eb2210 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.362394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 458/935] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:31.367379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a8c5b-c0b5-4549-9e42-fa3d217940fc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.368040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a8c5b-c0b5-4549-9e42-fa3d217940fc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.368544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a8c5b-c0b5-4549-9e42-fa3d217940fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.383949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c93b8-3728-41e3-942e-af739f8ba940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:31.384636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c93b8-3728-41e3-942e-af739f8ba940 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.384919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c93b8-3728-41e3-942e-af739f8ba940 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.385195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c93b8-3728-41e3-942e-af739f8ba940 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.385974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c93b8-3728-41e3-942e-af739f8ba940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:31.386280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c93b8-3728-41e3-942e-af739f8ba940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:31.387677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c93b8-3728-41e3-942e-af739f8ba940 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:31.390047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-6e1a8c5b-c0b5-4549-9e42-fa3d217940fc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:31.391685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6e1a8c5b-c0b5-4549-9e42-fa3d217940fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:31.401034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 478/936] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:31.406593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c93b8-3728-41e3-942e-af739f8ba940 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:31.469451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 459/937] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:31.492249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a8c5b-c0b5-4549-9e42-fa3d217940fc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:31.524380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c93b8-3728-41e3-942e-af739f8ba940 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:31.565440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754c25b-4283-4d9c-99b1-b6847904076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:31.566697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c25b-4283-4d9c-99b1-b6847904076f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.566697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c25b-4283-4d9c-99b1-b6847904076f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.566884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c25b-4283-4d9c-99b1-b6847904076f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.575507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754c25b-4283-4d9c-99b1-b6847904076f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:31.577335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754c25b-4283-4d9c-99b1-b6847904076f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-b754c25b-4283-4d9c-99b1-b6847904076f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:31.596405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:31.597649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:31.598608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:31.599171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a8c5b-c0b5-4549-9e42-fa3d217940fc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:31.599719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 479/938] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:44:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:31.601229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438823f-e2ed-4e19-a274-becc3bb6e428 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.601612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438823f-e2ed-4e19-a274-becc3bb6e428 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.601958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438823f-e2ed-4e19-a274-becc3bb6e428 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.603310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 480/939] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:31.604059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438823f-e2ed-4e19-a274-becc3bb6e428 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:31.636258 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3740b2-60a4-4c1d-8128-2152a7be26ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:31.637463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3740b2-60a4-4c1d-8128-2152a7be26ba None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.638201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3740b2-60a4-4c1d-8128-2152a7be26ba None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.638665 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3740b2-60a4-4c1d-8128-2152a7be26ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.639541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3740b2-60a4-4c1d-8128-2152a7be26ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:31.640891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3740b2-60a4-4c1d-8128-2152a7be26ba None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-fb3740b2-60a4-4c1d-8128-2152a7be26ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:31.653320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:31.654342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:31.655176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 460/940] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:31.658084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22414a83-ae0b-43cf-9623-3e546c01000b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.658606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22414a83-ae0b-43cf-9623-3e546c01000b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.659063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22414a83-ae0b-43cf-9623-3e546c01000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.675462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-22414a83-ae0b-43cf-9623-3e546c01000b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:31.676628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-22414a83-ae0b-43cf-9623-3e546c01000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:31.705333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438823f-e2ed-4e19-a274-becc3bb6e428 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:31.739138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8623657-8df2-4e02-86ec-94bf281c3202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:31.739730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8623657-8df2-4e02-86ec-94bf281c3202 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.740225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 461/941] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:31.741085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22414a83-ae0b-43cf-9623-3e546c01000b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:31.745344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8623657-8df2-4e02-86ec-94bf281c3202 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.745924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8623657-8df2-4e02-86ec-94bf281c3202 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.747024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8623657-8df2-4e02-86ec-94bf281c3202 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:31.747593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8623657-8df2-4e02-86ec-94bf281c3202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:31.749594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8623657-8df2-4e02-86ec-94bf281c3202 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:31.768018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 481/942] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 4 18:44:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:31.769158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8623657-8df2-4e02-86ec-94bf281c3202 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:31.841517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22414a83-ae0b-43cf-9623-3e546c01000b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:31.862106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8623657-8df2-4e02-86ec-94bf281c3202 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:31.875129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe0d87-4ca1-422e-a980-28528827798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:31.876015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe0d87-4ca1-422e-a980-28528827798f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.876299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe0d87-4ca1-422e-a980-28528827798f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.876597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe0d87-4ca1-422e-a980-28528827798f None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.877481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe0d87-4ca1-422e-a980-28528827798f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:31.877791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe0d87-4ca1-422e-a980-28528827798f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:31.879201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe0d87-4ca1-422e-a980-28528827798f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:31.889060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 462/943] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:31.889060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe0d87-4ca1-422e-a980-28528827798f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:31.900700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:31.901387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:31.901669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:31.901942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:31.902655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:31.904064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:31.905424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING keystone.server.flask.common [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 18:44:31.925756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.sql.core [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 18:44:31.925756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 18:44:31.925756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [parameters: {'id': '296114e9f7984ee5ba203ea65b9c7ff5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 18:44:31.925756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79827) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 296114e9f7984ee5ba203ea65b9c7ff5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 296114e9f7984ee5ba203ea65b9c7ff5. May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application conn.query(q) May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:44:31.942469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application result.read() May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 18:44:31.943509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application next(self.gen) May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application yield resource May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application next(self.gen) May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self.session.rollback() May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self.force_reraise() May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise self.value May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application session.commit() May 04 18:44:31.944521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._prepare_impl() May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self.session.flush() May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._flush(objects) May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application compat.raise_( May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application flush_context.execute() May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 18:44:31.945916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rec.execute(self) May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 18:44:31.946817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application conn.query(q) May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application result.read() May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:44:31.947605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [parameters: {'id': '296114e9f7984ee5ba203ea65b9c7ff5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:31.948498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:31.950185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 296114e9f7984ee5ba203ea65b9c7ff5. May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 482/944] 10.222.0.35 () {60 vars in 1140 bytes} [Wed May 4 18:44:31 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:31.951322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:31.997623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe0d87-4ca1-422e-a980-28528827798f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.031520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e163075-1c55-4763-9a22-9d6c3db127fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.032321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e163075-1c55-4763-9a22-9d6c3db127fb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.032601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e163075-1c55-4763-9a22-9d6c3db127fb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.032861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e163075-1c55-4763-9a22-9d6c3db127fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.042947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e163075-1c55-4763-9a22-9d6c3db127fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.044397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e163075-1c55-4763-9a22-9d6c3db127fb None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.049035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe489-bf2a-4bb3-8e07-7c6db86bfcfd None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-2e163075-1c55-4763-9a22-9d6c3db127fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:32.061617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:32.062557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:32.063472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:32.063472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:32.063472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:32.063472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:32.063472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 463/945] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:32.064388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e163075-1c55-4763-9a22-9d6c3db127fb None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:32.089626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c373ed-8b5c-4d3e-82e5-0b53d8f5ddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.090295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c373ed-8b5c-4d3e-82e5-0b53d8f5ddf7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.090584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c373ed-8b5c-4d3e-82e5-0b53d8f5ddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.090857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c373ed-8b5c-4d3e-82e5-0b53d8f5ddf7 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.091578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c373ed-8b5c-4d3e-82e5-0b53d8f5ddf7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:32.091882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c373ed-8b5c-4d3e-82e5-0b53d8f5ddf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.093482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c373ed-8b5c-4d3e-82e5-0b53d8f5ddf7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.106188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 483/946] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:32.106188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c373ed-8b5c-4d3e-82e5-0b53d8f5ddf7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:32.170263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e163075-1c55-4763-9a22-9d6c3db127fb None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.204053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c373ed-8b5c-4d3e-82e5-0b53d8f5ddf7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.204359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc5d21-c2b3-4865-b01b-fb4d0fb88943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.205109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc5d21-c2b3-4865-b01b-fb4d0fb88943 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.205648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc5d21-c2b3-4865-b01b-fb4d0fb88943 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.205924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc5d21-c2b3-4865-b01b-fb4d0fb88943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.213850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc5d21-c2b3-4865-b01b-fb4d0fb88943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.215345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc5d21-c2b3-4865-b01b-fb4d0fb88943 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-0ebc5d21-c2b3-4865-b01b-fb4d0fb88943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:32.228862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:32.229842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:32.230759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:32.230759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:32.230759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:32.230759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:32.230759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:32.230759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:32.230759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:32.230759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:32.230759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 464/947] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:32.231258 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc5d21-c2b3-4865-b01b-fb4d0fb88943 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:32.241810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edbd53-7707-478b-8d92-7ea982d2899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.242497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edbd53-7707-478b-8d92-7ea982d2899a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.242782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edbd53-7707-478b-8d92-7ea982d2899a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.243054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edbd53-7707-478b-8d92-7ea982d2899a None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.243783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edbd53-7707-478b-8d92-7ea982d2899a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:32.244359 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edbd53-7707-478b-8d92-7ea982d2899a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.245767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edbd53-7707-478b-8d92-7ea982d2899a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.262532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 484/948] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:32.262532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edbd53-7707-478b-8d92-7ea982d2899a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:32.339488 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc5d21-c2b3-4865-b01b-fb4d0fb88943 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.356587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edbd53-7707-478b-8d92-7ea982d2899a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.373137 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9742dd-fe9b-48d0-81ef-ea859a531be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.373824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9742dd-fe9b-48d0-81ef-ea859a531be2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.374423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9742dd-fe9b-48d0-81ef-ea859a531be2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.374693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9742dd-fe9b-48d0-81ef-ea859a531be2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.375483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9742dd-fe9b-48d0-81ef-ea859a531be2 None admin] RBAC: Adding query filter params (interface=public, service_id=9248a9c45f3149798752c8f726dbd391, region_id=RegionOne) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:32.375795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9742dd-fe9b-48d0-81ef-ea859a531be2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.377182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9742dd-fe9b-48d0-81ef-ea859a531be2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.386999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 465/949] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 4 18:44:32 2022] GET /identity/v3/endpoints?service_id=9248a9c45f3149798752c8f726dbd391&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:32.386999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9742dd-fe9b-48d0-81ef-ea859a531be2 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:32.389960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af698870-8c13-4b75-bf24-7886509a8a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.390697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af698870-8c13-4b75-bf24-7886509a8a86 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.390980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af698870-8c13-4b75-bf24-7886509a8a86 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.391255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af698870-8c13-4b75-bf24-7886509a8a86 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.392047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af698870-8c13-4b75-bf24-7886509a8a86 None admin] RBAC: Adding query filter params (name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:32.392358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af698870-8c13-4b75-bf24-7886509a8a86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.393895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af698870-8c13-4b75-bf24-7886509a8a86 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.413818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 485/950] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:32.413818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af698870-8c13-4b75-bf24-7886509a8a86 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:32.494324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9742dd-fe9b-48d0-81ef-ea859a531be2 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.528273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af698870-8c13-4b75-bf24-7886509a8a86 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.530057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8ecc8-6518-498f-ab57-bc13f37d9e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.531826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8ecc8-6518-498f-ab57-bc13f37d9e11 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.532172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8ecc8-6518-498f-ab57-bc13f37d9e11 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.532514 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8ecc8-6518-498f-ab57-bc13f37d9e11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.541624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8ecc8-6518-498f-ab57-bc13f37d9e11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.543771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8ecc8-6518-498f-ab57-bc13f37d9e11 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-83f8ecc8-6518-498f-ab57-bc13f37d9e11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:32.562685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:32.563680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:32.564902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:32.564902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:32.564902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:32.564902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:32.564902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:32.564902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:32.564902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:32.564902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:32.565822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6e669-eb84-4d8f-960e-c5b5f6519ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.565939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 466/951] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:32.568706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6e669-eb84-4d8f-960e-c5b5f6519ce0 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.569127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6e669-eb84-4d8f-960e-c5b5f6519ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.569463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6e669-eb84-4d8f-960e-c5b5f6519ce0 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.569843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8ecc8-6518-498f-ab57-bc13f37d9e11 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:32.570278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6e669-eb84-4d8f-960e-c5b5f6519ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.571682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6e669-eb84-4d8f-960e-c5b5f6519ce0 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.578443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 486/952] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 4 18:44:32 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:44:32.679650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8ecc8-6518-498f-ab57-bc13f37d9e11 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.715674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24bf8c-c777-4cf8-845a-9487dde259ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.716363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24bf8c-c777-4cf8-845a-9487dde259ba None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.716657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24bf8c-c777-4cf8-845a-9487dde259ba None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.716917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24bf8c-c777-4cf8-845a-9487dde259ba None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.717760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24bf8c-c777-4cf8-845a-9487dde259ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:32.718072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24bf8c-c777-4cf8-845a-9487dde259ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.719519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24bf8c-c777-4cf8-845a-9487dde259ba None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.732888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 467/953] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:32.738604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6e669-eb84-4d8f-960e-c5b5f6519ce0 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:32.845087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6e669-eb84-4d8f-960e-c5b5f6519ce0 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:32.878662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8e5e4-eaac-400a-957d-d7201db0dd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:32.879556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e5e4-eaac-400a-957d-d7201db0dd46 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:32.879836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e5e4-eaac-400a-957d-d7201db0dd46 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:32.880107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e5e4-eaac-400a-957d-d7201db0dd46 None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/86da4c4a11d74550aa59449b1bc5ca3d/roles/a6441f8a929f4bcd82b2c8fc4402e2f1` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:32.882431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8e5e4-eaac-400a-957d-d7201db0dd46 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=86da4c4a11d74550aa59449b1bc5ca3d, role_id=a6441f8a929f4bcd82b2c8fc4402e2f1)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:32.883849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8e5e4-eaac-400a-957d-d7201db0dd46 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:32.899691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 487/954] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:44:32 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/86da4c4a11d74550aa59449b1bc5ca3d/roles/a6441f8a929f4bcd82b2c8fc4402e2f1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:44:33.208269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169b83-e3e6-47eb-a19b-7d64a783f281 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:33.208449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169b83-e3e6-47eb-a19b-7d64a783f281 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:33.208735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169b83-e3e6-47eb-a19b-7d64a783f281 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:33.210329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 468/955] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:33.215742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4bfab-d8cb-48eb-89b6-7e85020fe69b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:33.216025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4bfab-d8cb-48eb-89b6-7e85020fe69b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:33.216299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4bfab-d8cb-48eb-89b6-7e85020fe69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:33.232957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-29d4bfab-d8cb-48eb-89b6-7e85020fe69b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:33.234486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-29d4bfab-d8cb-48eb-89b6-7e85020fe69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:33.303226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 488/956] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:33.325174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169b83-e3e6-47eb-a19b-7d64a783f281 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:33.430098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169b83-e3e6-47eb-a19b-7d64a783f281 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:33.465685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede25f6e-e50d-44b5-9b8d-a5333186757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:33.466305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede25f6e-e50d-44b5-9b8d-a5333186757b None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:33.466587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede25f6e-e50d-44b5-9b8d-a5333186757b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:33.466864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede25f6e-e50d-44b5-9b8d-a5333186757b None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:33.467674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede25f6e-e50d-44b5-9b8d-a5333186757b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:33.469042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede25f6e-e50d-44b5-9b8d-a5333186757b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:33.484239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 469/957] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:44:33 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:34.837032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81686a-bb0d-460d-a109-b908fce9db64 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:34.838171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81686a-bb0d-460d-a109-b908fce9db64 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:34.838658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81686a-bb0d-460d-a109-b908fce9db64 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:34.840521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 489/958] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:34.846215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddbf91-2c97-4b28-93ff-da96c16a9cbc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:34.847040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddbf91-2c97-4b28-93ff-da96c16a9cbc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:34.847520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddbf91-2c97-4b28-93ff-da96c16a9cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:34.864791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-beddbf91-2c97-4b28-93ff-da96c16a9cbc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:34.866391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-beddbf91-2c97-4b28-93ff-da96c16a9cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:34.876208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32125b-2fd6-45b9-8490-0e114b130e06 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:34.876777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32125b-2fd6-45b9-8490-0e114b130e06 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:34.877360 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32125b-2fd6-45b9-8490-0e114b130e06 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:34.879163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 490/959] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:34.884208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd1391-5148-4acd-bf8b-dbec74af7343 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:34.884734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd1391-5148-4acd-bf8b-dbec74af7343 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:34.885215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd1391-5148-4acd-bf8b-dbec74af7343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:34.901827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-7afd1391-5148-4acd-bf8b-dbec74af7343 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:34.903346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-7afd1391-5148-4acd-bf8b-dbec74af7343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:34.949386 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 470/960] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:34.967562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddbf91-2c97-4b28-93ff-da96c16a9cbc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:34.969853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 491/961] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:34.993406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd1391-5148-4acd-bf8b-dbec74af7343 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:35.069270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddbf91-2c97-4b28-93ff-da96c16a9cbc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:35.099787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd1391-5148-4acd-bf8b-dbec74af7343 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:35.104572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:35.105353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.105703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.106042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.106811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:35.108305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:35.109737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WARNING keystone.server.flask.common [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 18:44:35.124719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.sql.core [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 18:44:35.124719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 18:44:35.124719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [parameters: {'user_id': 'c64d011a3b8b466b8654e62f72d4dc88', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 18:44:35.124719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79826) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application conn.query(q) May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application result.read() May 04 18:44:35.132452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:44:35.133368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application next(self.gen) May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application yield resource May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application next(self.gen) May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.session.rollback() May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.force_reraise() May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise self.value May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application session.commit() May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 18:44:35.134317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._prepare_impl() May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.session.flush() May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._flush(objects) May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application compat.raise_( May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application flush_context.execute() May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rec.execute(self) May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 18:44:35.135202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 18:44:35.136099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application result = self._query(query) May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application conn.query(q) May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application result.read() May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 18:44:35.136943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c64d011a3b8b466b8654e62f72d4dc88', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:35.137820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 18:44:35.140964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 18:44:35.143281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 18:44:35.143281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 18:44:35.143281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 18:44:35.143281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 18:44:35.143281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 18:44:35.143281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:35.143281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 471/962] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 4 18:44:34 2022] POST /identity/v3/users => generated 160 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:35.143281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:35.146059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e8282-2322-463e-9efc-2f08daa1bcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:35.146059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e8282-2322-463e-9efc-2f08daa1bcc5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.146417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e8282-2322-463e-9efc-2f08daa1bcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.146417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e8282-2322-463e-9efc-2f08daa1bcc5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.147245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e8282-2322-463e-9efc-2f08daa1bcc5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:35.149601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e8282-2322-463e-9efc-2f08daa1bcc5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a44e8282-2322-463e-9efc-2f08daa1bcc5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:35.164213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:35.165262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:35.166128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:35.169378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 492/963] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:35.171321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e8282-2322-463e-9efc-2f08daa1bcc5 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:35.255699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e03d55-5467-4ab1-91b6-1fc29f48ecca None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:35.276488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e8282-2322-463e-9efc-2f08daa1bcc5 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:35.289479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d99bd1-d8c4-4205-b33b-0970f672ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:35.290283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d99bd1-d8c4-4205-b33b-0970f672ceaf None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.290558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d99bd1-d8c4-4205-b33b-0970f672ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.290817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d99bd1-d8c4-4205-b33b-0970f672ceaf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.298404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d99bd1-d8c4-4205-b33b-0970f672ceaf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:35.300173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d99bd1-d8c4-4205-b33b-0970f672ceaf None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:35.309177 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493449b-6b7a-4596-8125-2a96e2c33321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:35.309869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493449b-6b7a-4596-8125-2a96e2c33321 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.310151 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493449b-6b7a-4596-8125-2a96e2c33321 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.310422 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493449b-6b7a-4596-8125-2a96e2c33321 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.311131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493449b-6b7a-4596-8125-2a96e2c33321 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:35.311436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493449b-6b7a-4596-8125-2a96e2c33321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:35.312789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493449b-6b7a-4596-8125-2a96e2c33321 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-20d99bd1-d8c4-4205-b33b-0970f672ceaf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:35.313900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:35.314836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:35.315805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 472/964] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:35.316982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ed1e0-2bcf-4d91-bb37-6920aa81fdb4 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.317216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ed1e0-2bcf-4d91-bb37-6920aa81fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.317517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ed1e0-2bcf-4d91-bb37-6920aa81fdb4 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.326063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 473/965] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:35.326063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ed1e0-2bcf-4d91-bb37-6920aa81fdb4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:35.326290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 493/966] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:35.327244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914880f-a990-4331-8f39-0904643e3620 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.327746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914880f-a990-4331-8f39-0904643e3620 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.328130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914880f-a990-4331-8f39-0904643e3620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.344594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-7914880f-a990-4331-8f39-0904643e3620 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:35.345802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-7914880f-a990-4331-8f39-0904643e3620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:35.422993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 494/967] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:35.422993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914880f-a990-4331-8f39-0904643e3620 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:35.442648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ed1e0-2bcf-4d91-bb37-6920aa81fdb4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:35.475259 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd5a2b-0b4a-4b61-85a4-e73f924fdc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:35.475938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5a2b-0b4a-4b61-85a4-e73f924fdc34 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.476216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5a2b-0b4a-4b61-85a4-e73f924fdc34 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.476492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5a2b-0b4a-4b61-85a4-e73f924fdc34 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.477321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd5a2b-0b4a-4b61-85a4-e73f924fdc34 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:35.477635 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd5a2b-0b4a-4b61-85a4-e73f924fdc34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:35.479059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd5a2b-0b4a-4b61-85a4-e73f924fdc34 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:35.516605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 474/968] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 4 18:44:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:35.517915 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd5a2b-0b4a-4b61-85a4-e73f924fdc34 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:35.552504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914880f-a990-4331-8f39-0904643e3620 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:35.593767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc55e7-7ef2-44ae-a1f2-3a434684f3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:35.594835 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc55e7-7ef2-44ae-a1f2-3a434684f3e7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.595298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc55e7-7ef2-44ae-a1f2-3a434684f3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.595781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc55e7-7ef2-44ae-a1f2-3a434684f3e7 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.596839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc55e7-7ef2-44ae-a1f2-3a434684f3e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:35.597405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc55e7-7ef2-44ae-a1f2-3a434684f3e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:35.599221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc55e7-7ef2-44ae-a1f2-3a434684f3e7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:35.605394 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 495/969] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:35.611228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc55e7-7ef2-44ae-a1f2-3a434684f3e7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:35.653608 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd5a2b-0b4a-4b61-85a4-e73f924fdc34 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:35.690877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74648f86-e31b-49fd-a236-56e42c903472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:35.692068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74648f86-e31b-49fd-a236-56e42c903472 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.692568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74648f86-e31b-49fd-a236-56e42c903472 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.693038 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74648f86-e31b-49fd-a236-56e42c903472 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.704599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74648f86-e31b-49fd-a236-56e42c903472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-74648f86-e31b-49fd-a236-56e42c903472 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:35.713385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:35.714560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:35.715892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 475/970] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 4 18:44:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:35.717171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819aca9-318d-4dc7-a519-2ab9ff2210ab None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.717480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819aca9-318d-4dc7-a519-2ab9ff2210ab None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.717755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819aca9-318d-4dc7-a519-2ab9ff2210ab None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.719249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 476/971] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:35.720950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc55e7-7ef2-44ae-a1f2-3a434684f3e7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:35.721075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819aca9-318d-4dc7-a519-2ab9ff2210ab None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:35.756428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0b2eb-3482-463d-a2d9-12db9681ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:35.757126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b2eb-3482-463d-a2d9-12db9681ed18 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.757508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b2eb-3482-463d-a2d9-12db9681ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.757834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b2eb-3482-463d-a2d9-12db9681ed18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.758744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0b2eb-3482-463d-a2d9-12db9681ed18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:35.760371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0b2eb-3482-463d-a2d9-12db9681ed18 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:35.790217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 496/972] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 4 18:44:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:44:35.792491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a34d-9b7b-4f3e-a80b-29a667830203 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.792780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a34d-9b7b-4f3e-a80b-29a667830203 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.793057 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a34d-9b7b-4f3e-a80b-29a667830203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.815472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a8a8a34d-9b7b-4f3e-a80b-29a667830203 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:35.815472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a8a8a34d-9b7b-4f3e-a80b-29a667830203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:35.845990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819aca9-318d-4dc7-a519-2ab9ff2210ab None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:35.883348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ecdd0-a6f4-4403-b170-efd3c4ae8aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:35.884323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ecdd0-a6f4-4403-b170-efd3c4ae8aa9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:35.884610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ecdd0-a6f4-4403-b170-efd3c4ae8aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:35.884886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ecdd0-a6f4-4403-b170-efd3c4ae8aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:35.885690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ecdd0-a6f4-4403-b170-efd3c4ae8aa9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:35.885999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ecdd0-a6f4-4403-b170-efd3c4ae8aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:35.887383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ecdd0-a6f4-4403-b170-efd3c4ae8aa9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:35.889443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 497/973] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:35.901329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 477/974] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 4 18:44:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:35.902726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8a34d-9b7b-4f3e-a80b-29a667830203 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:35.910616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ecdd0-a6f4-4403-b170-efd3c4ae8aa9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.010168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8a34d-9b7b-4f3e-a80b-29a667830203 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.013245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ecdd0-a6f4-4403-b170-efd3c4ae8aa9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.042537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863250f-ea56-49b2-b342-e6625606aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.043345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863250f-ea56-49b2-b342-e6625606aa72 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.043632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863250f-ea56-49b2-b342-e6625606aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.043912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863250f-ea56-49b2-b342-e6625606aa72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.045313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481416f9-4b30-4498-b85f-a7375395d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.046270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481416f9-4b30-4498-b85f-a7375395d37f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.046692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481416f9-4b30-4498-b85f-a7375395d37f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.047143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481416f9-4b30-4498-b85f-a7375395d37f None admin] PATH_INFO: `/v3/services/compute` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.048003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481416f9-4b30-4498-b85f-a7375395d37f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.049611 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481416f9-4b30-4498-b85f-a7375395d37f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.053827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863250f-ea56-49b2-b342-e6625606aa72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.055249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863250f-ea56-49b2-b342-e6625606aa72 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-481416f9-4b30-4498-b85f-a7375395d37f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:36.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:36.062941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:36.064431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 478/975] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:36.068639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481416f9-4b30-4498-b85f-a7375395d37f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-c863250f-ea56-49b2-b342-e6625606aa72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:36.073343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:36.074351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:36.075820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:36.075820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:36.075820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:36.075820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:36.075820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 498/976] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:36.080104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863250f-ea56-49b2-b342-e6625606aa72 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.166930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481416f9-4b30-4498-b85f-a7375395d37f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.178481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863250f-ea56-49b2-b342-e6625606aa72 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.198644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c51a7-5ef7-4047-b4ec-2956fd874526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.199304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c51a7-5ef7-4047-b4ec-2956fd874526 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.199584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c51a7-5ef7-4047-b4ec-2956fd874526 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.199847 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c51a7-5ef7-4047-b4ec-2956fd874526 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.200571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c51a7-5ef7-4047-b4ec-2956fd874526 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:36.200857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c51a7-5ef7-4047-b4ec-2956fd874526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.202230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c51a7-5ef7-4047-b4ec-2956fd874526 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.207625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 479/977] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:36.212815 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c51a7-5ef7-4047-b4ec-2956fd874526 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.216046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f2fb-1a14-4841-932d-e633c3dd883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.216796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f2fb-1a14-4841-932d-e633c3dd883f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.217083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f2fb-1a14-4841-932d-e633c3dd883f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.217392 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f2fb-1a14-4841-932d-e633c3dd883f None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.218158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080f2fb-1a14-4841-932d-e633c3dd883f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:36.218466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080f2fb-1a14-4841-932d-e633c3dd883f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.219885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080f2fb-1a14-4841-932d-e633c3dd883f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.231297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 499/978] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:36.236718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f2fb-1a14-4841-932d-e633c3dd883f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.309122 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c51a7-5ef7-4047-b4ec-2956fd874526 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.335439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f2fb-1a14-4841-932d-e633c3dd883f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.341154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee78cf-5d00-4068-9c26-0a55ef1d8fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.341844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee78cf-5d00-4068-9c26-0a55ef1d8fb5 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.342121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee78cf-5d00-4068-9c26-0a55ef1d8fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.342397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee78cf-5d00-4068-9c26-0a55ef1d8fb5 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.343105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee78cf-5d00-4068-9c26-0a55ef1d8fb5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:36.343408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee78cf-5d00-4068-9c26-0a55ef1d8fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.344771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee78cf-5d00-4068-9c26-0a55ef1d8fb5 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.349894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 480/979] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:36.355387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee78cf-5d00-4068-9c26-0a55ef1d8fb5 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.371534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8788a-1e26-4fea-829b-b03c5d0ddfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.372430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8788a-1e26-4fea-829b-b03c5d0ddfec None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.372794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8788a-1e26-4fea-829b-b03c5d0ddfec None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.373136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8788a-1e26-4fea-829b-b03c5d0ddfec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.381171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8788a-1e26-4fea-829b-b03c5d0ddfec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.382689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8788a-1e26-4fea-829b-b03c5d0ddfec None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-51a8788a-1e26-4fea-829b-b03c5d0ddfec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:36.396987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:36.398287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:36.399353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 500/980] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:44:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:36.404393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8788a-1e26-4fea-829b-b03c5d0ddfec None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.460121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee78cf-5d00-4068-9c26-0a55ef1d8fb5 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.491926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa9ddb-c700-4b82-84aa-eef7d8efb3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.492593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9ddb-c700-4b82-84aa-eef7d8efb3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.492866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9ddb-c700-4b82-84aa-eef7d8efb3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.493136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9ddb-c700-4b82-84aa-eef7d8efb3d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.493965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9ddb-c700-4b82-84aa-eef7d8efb3d2 None admin] RBAC: Adding query filter params (interface=public, service_id=26df89ccbdde4557ad9bdfbbe15c8b78, region_id=RegionOne) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:36.494262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9ddb-c700-4b82-84aa-eef7d8efb3d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.495605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9ddb-c700-4b82-84aa-eef7d8efb3d2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.500781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 481/981] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 4 18:44:36 2022] GET /identity/v3/endpoints?service_id=26df89ccbdde4557ad9bdfbbe15c8b78&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:36.506470 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa9ddb-c700-4b82-84aa-eef7d8efb3d2 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.510298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8788a-1e26-4fea-829b-b03c5d0ddfec None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.548106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7ab0-986e-4470-aa8b-54cc019dbf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.548779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7ab0-986e-4470-aa8b-54cc019dbf0d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.549082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7ab0-986e-4470-aa8b-54cc019dbf0d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.549388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7ab0-986e-4470-aa8b-54cc019dbf0d None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.550221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba7ab0-986e-4470-aa8b-54cc019dbf0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:36.550527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba7ab0-986e-4470-aa8b-54cc019dbf0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.551946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba7ab0-986e-4470-aa8b-54cc019dbf0d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.573846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 501/982] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 4 18:44:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:36.574818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7ab0-986e-4470-aa8b-54cc019dbf0d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.614132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa9ddb-c700-4b82-84aa-eef7d8efb3d2 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.647407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b472a6-a027-4101-9a94-131f689b0fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.648424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b472a6-a027-4101-9a94-131f689b0fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.648905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b472a6-a027-4101-9a94-131f689b0fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.649431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b472a6-a027-4101-9a94-131f689b0fb7 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.650310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b472a6-a027-4101-9a94-131f689b0fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.651893 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b472a6-a027-4101-9a94-131f689b0fb7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.658428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 482/983] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 4 18:44:36 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:44:36.670820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7ab0-986e-4470-aa8b-54cc019dbf0d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:36.708276 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff034c-c1f1-49cd-8a66-06efcaeabe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:36.708938 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff034c-c1f1-49cd-8a66-06efcaeabe14 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:36.709213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff034c-c1f1-49cd-8a66-06efcaeabe14 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:36.709509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff034c-c1f1-49cd-8a66-06efcaeabe14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:36.779129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff034c-c1f1-49cd-8a66-06efcaeabe14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:36.780581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff034c-c1f1-49cd-8a66-06efcaeabe14 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:36.879751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 502/984] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:36 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:44:36.885808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b472a6-a027-4101-9a94-131f689b0fb7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:36.988668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b472a6-a027-4101-9a94-131f689b0fb7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:37.022339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990386a-3c9a-4702-bc7b-3160b0ae1af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:37.023134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990386a-3c9a-4702-bc7b-3160b0ae1af9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:37.023412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990386a-3c9a-4702-bc7b-3160b0ae1af9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:37.023683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990386a-3c9a-4702-bc7b-3160b0ae1af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:37.033967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990386a-3c9a-4702-bc7b-3160b0ae1af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:37.035398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990386a-3c9a-4702-bc7b-3160b0ae1af9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-c990386a-3c9a-4702-bc7b-3160b0ae1af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:37.051864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:37.052765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:37.061579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:37.061579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:37.061579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:37.061579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:37.061579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 483/985] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:37.061877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff034c-c1f1-49cd-8a66-06efcaeabe14 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:37.157263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff034c-c1f1-49cd-8a66-06efcaeabe14 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:37.189562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c005bc-2ec7-45c4-a279-d4d2f94b00b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:37.190246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c005bc-2ec7-45c4-a279-d4d2f94b00b3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:37.190520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c005bc-2ec7-45c4-a279-d4d2f94b00b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:37.190786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c005bc-2ec7-45c4-a279-d4d2f94b00b3 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:37.191507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c005bc-2ec7-45c4-a279-d4d2f94b00b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:37.191811 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c005bc-2ec7-45c4-a279-d4d2f94b00b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:37.193180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c005bc-2ec7-45c4-a279-d4d2f94b00b3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:37.204050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 503/986] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:37.209564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990386a-3c9a-4702-bc7b-3160b0ae1af9 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:37.305325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990386a-3c9a-4702-bc7b-3160b0ae1af9 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:37.339104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb1690-d6cb-4517-bee0-23afd27402d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:37.339904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb1690-d6cb-4517-bee0-23afd27402d5 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:37.340178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb1690-d6cb-4517-bee0-23afd27402d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:37.340444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb1690-d6cb-4517-bee0-23afd27402d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:37.347161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb1690-d6cb-4517-bee0-23afd27402d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:37.348586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb1690-d6cb-4517-bee0-23afd27402d5 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-33bb1690-d6cb-4517-bee0-23afd27402d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:37.362481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:37.363390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:37.364278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:37.364278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:37.364278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:37.364278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:37.364278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:37.364278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:37.364278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:37.364278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:37.365356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 484/987] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:37.369505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c005bc-2ec7-45c4-a279-d4d2f94b00b3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:37.471414 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c005bc-2ec7-45c4-a279-d4d2f94b00b3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:37.506285 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c92ccb-2697-47e7-9daa-c7603c10581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:37.506982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c92ccb-2697-47e7-9daa-c7603c10581d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:37.507257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c92ccb-2697-47e7-9daa-c7603c10581d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:37.507783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c92ccb-2697-47e7-9daa-c7603c10581d None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:37.508621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c92ccb-2697-47e7-9daa-c7603c10581d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:37.508905 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c92ccb-2697-47e7-9daa-c7603c10581d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:37.510398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c92ccb-2697-47e7-9daa-c7603c10581d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:37.523106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 504/988] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:37.529184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb1690-d6cb-4517-bee0-23afd27402d5 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:37.628067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb1690-d6cb-4517-bee0-23afd27402d5 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:37.661690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9849e-4519-4c4a-abc4-c52f6a0429c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:37.662365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9849e-4519-4c4a-abc4-c52f6a0429c2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:37.662637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9849e-4519-4c4a-abc4-c52f6a0429c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:37.662908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9849e-4519-4c4a-abc4-c52f6a0429c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:37.663750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9849e-4519-4c4a-abc4-c52f6a0429c2 None admin] RBAC: Adding query filter params (role.id=a6441f8a929f4bcd82b2c8fc4402e2f1, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=86da4c4a11d74550aa59449b1bc5ca3d) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:37.664054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9849e-4519-4c4a-abc4-c52f6a0429c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:37.665535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9849e-4519-4c4a-abc4-c52f6a0429c2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:37.671637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 485/989] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:37 2022] GET /identity/v3/role_assignments?user.id=86da4c4a11d74550aa59449b1bc5ca3d&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=a6441f8a929f4bcd82b2c8fc4402e2f1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:38.102754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4cb78-ac16-4fa9-b975-fcfc4cda82f1 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:38.103335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4cb78-ac16-4fa9-b975-fcfc4cda82f1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:38.103335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4cb78-ac16-4fa9-b975-fcfc4cda82f1 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:38.104824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 505/990] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:38.110243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285f92-8440-4042-9e8c-4d30e1e6e27b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:38.110684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285f92-8440-4042-9e8c-4d30e1e6e27b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:38.110806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285f92-8440-4042-9e8c-4d30e1e6e27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:38.128871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-38285f92-8440-4042-9e8c-4d30e1e6e27b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:38.130533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-38285f92-8440-4042-9e8c-4d30e1e6e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:38.194561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 486/991] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:38.216880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4cb78-ac16-4fa9-b975-fcfc4cda82f1 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:38.312801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4cb78-ac16-4fa9-b975-fcfc4cda82f1 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:38.347083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b1b68-124e-441c-beec-3a6bbb0d26d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:38.347885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b1b68-124e-441c-beec-3a6bbb0d26d1 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:38.348161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b1b68-124e-441c-beec-3a6bbb0d26d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:38.348433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b1b68-124e-441c-beec-3a6bbb0d26d1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:38.349079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b1b68-124e-441c-beec-3a6bbb0d26d1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:38.350470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b1b68-124e-441c-beec-3a6bbb0d26d1 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-b85b1b68-124e-441c-beec-3a6bbb0d26d1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:38.362475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:38.363513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:38.364364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:38.366002 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 506/992] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:38.369565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38285f92-8440-4042-9e8c-4d30e1e6e27b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:38.469260 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38285f92-8440-4042-9e8c-4d30e1e6e27b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:38.503134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa28b02-3763-4ae1-a544-c3cd2e1c9184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:38.504205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa28b02-3763-4ae1-a544-c3cd2e1c9184 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:38.504784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa28b02-3763-4ae1-a544-c3cd2e1c9184 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:38.505304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa28b02-3763-4ae1-a544-c3cd2e1c9184 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:38.506216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa28b02-3763-4ae1-a544-c3cd2e1c9184 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:38.506728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa28b02-3763-4ae1-a544-c3cd2e1c9184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:38.508311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa28b02-3763-4ae1-a544-c3cd2e1c9184 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:38.513763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 487/993] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:38.519691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b1b68-124e-441c-beec-3a6bbb0d26d1 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:38.619683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b1b68-124e-441c-beec-3a6bbb0d26d1 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:38.655072 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a8842-9971-495f-a0c8-6406ed1dfff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:38.656127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a8842-9971-495f-a0c8-6406ed1dfff4 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:38.656628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a8842-9971-495f-a0c8-6406ed1dfff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:38.657101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a8842-9971-495f-a0c8-6406ed1dfff4 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:38.658042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a8842-9971-495f-a0c8-6406ed1dfff4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:38.658638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a8842-9971-495f-a0c8-6406ed1dfff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:38.660210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a8842-9971-495f-a0c8-6406ed1dfff4 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:38.665482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 507/994] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:38.671052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa28b02-3763-4ae1-a544-c3cd2e1c9184 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:38.775982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa28b02-3763-4ae1-a544-c3cd2e1c9184 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:38.811944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cd6d8-9cb3-4408-9ac9-1382237fdfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:38.813034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd6d8-9cb3-4408-9ac9-1382237fdfaf None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:38.813555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd6d8-9cb3-4408-9ac9-1382237fdfaf None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:38.814032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd6d8-9cb3-4408-9ac9-1382237fdfaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:38.815261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cd6d8-9cb3-4408-9ac9-1382237fdfaf None admin] RBAC: Adding query filter params (interface=admin, service_id=9248a9c45f3149798752c8f726dbd391, region_id=RegionOne) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:38.815791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cd6d8-9cb3-4408-9ac9-1382237fdfaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:38.817399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cd6d8-9cb3-4408-9ac9-1382237fdfaf None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:38.824004 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 488/995] 10.222.0.35 () {56 vars in 1249 bytes} [Wed May 4 18:44:38 2022] GET /identity/v3/endpoints?service_id=9248a9c45f3149798752c8f726dbd391&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:38.829711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a8842-9971-495f-a0c8-6406ed1dfff4 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:38.927253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a8842-9971-495f-a0c8-6406ed1dfff4 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:38.932580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aebb0b-856e-4835-a4ef-b42ff72bc813 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:38.932882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aebb0b-856e-4835-a4ef-b42ff72bc813 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:38.933159 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aebb0b-856e-4835-a4ef-b42ff72bc813 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:38.934743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 489/996] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:38.939692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1d40d-4f94-453b-95d9-59d8b9786763 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:38.939949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1d40d-4f94-453b-95d9-59d8b9786763 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:38.940230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1d40d-4f94-453b-95d9-59d8b9786763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:38.958128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-f0d1d40d-4f94-453b-95d9-59d8b9786763 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:38.959317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f0d1d40d-4f94-453b-95d9-59d8b9786763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:38.961097 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b849e-1eca-4f29-9f68-0f0cd2cf5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:38.961787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b849e-1eca-4f29-9f68-0f0cd2cf5c0e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:38.962066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b849e-1eca-4f29-9f68-0f0cd2cf5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:38.962334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b849e-1eca-4f29-9f68-0f0cd2cf5c0e None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:38.963025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b849e-1eca-4f29-9f68-0f0cd2cf5c0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:38.964430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b849e-1eca-4f29-9f68-0f0cd2cf5c0e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:38.970766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 508/997] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 4 18:44:38 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:44:39.030643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 490/998] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:39.053939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b849e-1eca-4f29-9f68-0f0cd2cf5c0e None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:39.158698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b849e-1eca-4f29-9f68-0f0cd2cf5c0e None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:39.192425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af5027-1819-4dba-a289-25a74b5b2f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:39.193145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af5027-1819-4dba-a289-25a74b5b2f43 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:39.193445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af5027-1819-4dba-a289-25a74b5b2f43 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:39.193708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af5027-1819-4dba-a289-25a74b5b2f43 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:39.194356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af5027-1819-4dba-a289-25a74b5b2f43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:39.195723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af5027-1819-4dba-a289-25a74b5b2f43 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-53af5027-1819-4dba-a289-25a74b5b2f43 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:39.207603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:39.208605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:39.209675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 509/999] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:39.214790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1d40d-4f94-453b-95d9-59d8b9786763 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:39.312301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1d40d-4f94-453b-95d9-59d8b9786763 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:39.345669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc957e-919a-428b-a4f8-ee8710ba6e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:39.346397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc957e-919a-428b-a4f8-ee8710ba6e05 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:39.346675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc957e-919a-428b-a4f8-ee8710ba6e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:39.346946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc957e-919a-428b-a4f8-ee8710ba6e05 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:39.347654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc957e-919a-428b-a4f8-ee8710ba6e05 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:39.347956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc957e-919a-428b-a4f8-ee8710ba6e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:39.349309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc957e-919a-428b-a4f8-ee8710ba6e05 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:39.354393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 491/1000] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:39.359894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af5027-1819-4dba-a289-25a74b5b2f43 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:39.463124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af5027-1819-4dba-a289-25a74b5b2f43 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:39.496025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65787245-5cc4-44f2-b905-e87fd3b579bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:39.496680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65787245-5cc4-44f2-b905-e87fd3b579bd None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:39.496960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65787245-5cc4-44f2-b905-e87fd3b579bd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:39.497236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65787245-5cc4-44f2-b905-e87fd3b579bd None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:39.497966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65787245-5cc4-44f2-b905-e87fd3b579bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:39.498271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65787245-5cc4-44f2-b905-e87fd3b579bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:39.499964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65787245-5cc4-44f2-b905-e87fd3b579bd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:39.504863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 510/1001] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 4 18:44:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:39.510412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc957e-919a-428b-a4f8-ee8710ba6e05 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:39.613343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc957e-919a-428b-a4f8-ee8710ba6e05 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:39.645963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5717c4b-aa9f-419d-9424-f2e687542003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:39.646626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5717c4b-aa9f-419d-9424-f2e687542003 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:39.646909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5717c4b-aa9f-419d-9424-f2e687542003 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:39.647175 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5717c4b-aa9f-419d-9424-f2e687542003 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:39.647897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5717c4b-aa9f-419d-9424-f2e687542003 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:39.649246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5717c4b-aa9f-419d-9424-f2e687542003 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:39.669652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 492/1002] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 4 18:44:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:44:39.946620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93770044-f5e7-457c-a565-277041192f03 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:39.946902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93770044-f5e7-457c-a565-277041192f03 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:39.947210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93770044-f5e7-457c-a565-277041192f03 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:39.948546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 511/1003] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:39.953996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13ac0-1d85-40f5-8fb8-645d94f2bfb8 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:39.954287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13ac0-1d85-40f5-8fb8-645d94f2bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:39.954567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13ac0-1d85-40f5-8fb8-645d94f2bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:39.971662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9de13ac0-1d85-40f5-8fb8-645d94f2bfb8 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:39.972891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9de13ac0-1d85-40f5-8fb8-645d94f2bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:40.041933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 493/1004] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:39 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:40.063987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93770044-f5e7-457c-a565-277041192f03 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:40.166292 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93770044-f5e7-457c-a565-277041192f03 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:40.199385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3c3fc-da0b-4464-844f-86233ecd7c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:40.200103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3c3fc-da0b-4464-844f-86233ecd7c75 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:40.200379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3c3fc-da0b-4464-844f-86233ecd7c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:40.200649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3c3fc-da0b-4464-844f-86233ecd7c75 None admin] PATH_INFO: `/v3/services/image` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:40.201321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3c3fc-da0b-4464-844f-86233ecd7c75 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:40.202708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3c3fc-da0b-4464-844f-86233ecd7c75 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-f0c3c3fc-da0b-4464-844f-86233ecd7c75 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:40.213818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:40.214804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:44:40.215696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:40.217371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 512/1005] 10.222.0.35 () {56 vars in 1105 bytes} [Wed May 4 18:44:40 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:40.221229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13ac0-1d85-40f5-8fb8-645d94f2bfb8 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:40.312809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13ac0-1d85-40f5-8fb8-645d94f2bfb8 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:40.346552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b97f2-c125-4f6d-adc1-d5936d851e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:40.347230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b97f2-c125-4f6d-adc1-d5936d851e49 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:40.347481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b97f2-c125-4f6d-adc1-d5936d851e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:40.347768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b97f2-c125-4f6d-adc1-d5936d851e49 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:40.348472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b97f2-c125-4f6d-adc1-d5936d851e49 None admin] RBAC: Adding query filter params (name=image) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:40.348773 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b97f2-c125-4f6d-adc1-d5936d851e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:40.350155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b97f2-c125-4f6d-adc1-d5936d851e49 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:40.355044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 494/1006] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:40.360524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3c3fc-da0b-4464-844f-86233ecd7c75 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:40.460312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3c3fc-da0b-4464-844f-86233ecd7c75 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:40.491294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b50ed8-f0de-42fb-b94e-af4674bfc4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:40.491952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b50ed8-f0de-42fb-b94e-af4674bfc4f9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:40.492229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b50ed8-f0de-42fb-b94e-af4674bfc4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:40.492497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b50ed8-f0de-42fb-b94e-af4674bfc4f9 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:40.493201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b50ed8-f0de-42fb-b94e-af4674bfc4f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:40.493532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b50ed8-f0de-42fb-b94e-af4674bfc4f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:40.494884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b50ed8-f0de-42fb-b94e-af4674bfc4f9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:40.499907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 513/1007] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:41.214275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488c45b-b27e-4a50-b8c3-e6cf4dfec667 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:41.214517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488c45b-b27e-4a50-b8c3-e6cf4dfec667 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:41.214809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488c45b-b27e-4a50-b8c3-e6cf4dfec667 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:41.216354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 495/1008] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:41.221453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb20284-6b0b-49c0-afed-f8cb335a0c17 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:41.221913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb20284-6b0b-49c0-afed-f8cb335a0c17 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:41.222013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb20284-6b0b-49c0-afed-f8cb335a0c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:41.238925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-4cb20284-6b0b-49c0-afed-f8cb335a0c17 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:41.240101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4cb20284-6b0b-49c0-afed-f8cb335a0c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:41.305708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 514/1009] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:41 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:41.328065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488c45b-b27e-4a50-b8c3-e6cf4dfec667 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:41.426141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488c45b-b27e-4a50-b8c3-e6cf4dfec667 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:41.465200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323b345-696a-4184-9bd2-37749616b41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:41.466005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b345-696a-4184-9bd2-37749616b41e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:41.466288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b345-696a-4184-9bd2-37749616b41e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:41.466563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b345-696a-4184-9bd2-37749616b41e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:41.467229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323b345-696a-4184-9bd2-37749616b41e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:41.468594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323b345-696a-4184-9bd2-37749616b41e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-a323b345-696a-4184-9bd2-37749616b41e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:41.480677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:41.481948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 18:44:41.482783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:41.485624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 496/1010] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 4 18:44:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:41.488009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb20284-6b0b-49c0-afed-f8cb335a0c17 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:41.590428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb20284-6b0b-49c0-afed-f8cb335a0c17 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:41.627854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59f8d1-cf4a-487b-a608-6a8337355923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:41.628519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f8d1-cf4a-487b-a608-6a8337355923 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:41.628803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f8d1-cf4a-487b-a608-6a8337355923 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:41.629077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f8d1-cf4a-487b-a608-6a8337355923 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:41.629820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59f8d1-cf4a-487b-a608-6a8337355923 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:41.630128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59f8d1-cf4a-487b-a608-6a8337355923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:41.631489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59f8d1-cf4a-487b-a608-6a8337355923 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:41.636451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 515/1011] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:41.642102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323b345-696a-4184-9bd2-37749616b41e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:41.741262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323b345-696a-4184-9bd2-37749616b41e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:41.775624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453f074-53ce-423f-8bf2-01fe9206ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:41.776288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453f074-53ce-423f-8bf2-01fe9206ab59 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:41.776568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453f074-53ce-423f-8bf2-01fe9206ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:41.776839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453f074-53ce-423f-8bf2-01fe9206ab59 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:41.777581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453f074-53ce-423f-8bf2-01fe9206ab59 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:41.777886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453f074-53ce-423f-8bf2-01fe9206ab59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:41.779278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453f074-53ce-423f-8bf2-01fe9206ab59 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:41.784402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 497/1012] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 4 18:44:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:41.790121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59f8d1-cf4a-487b-a608-6a8337355923 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:41.894175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59f8d1-cf4a-487b-a608-6a8337355923 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:41.928267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f3516-1c8c-41b9-ac66-6f9fd286b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:41.928946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f3516-1c8c-41b9-ac66-6f9fd286b0b8 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:41.929228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f3516-1c8c-41b9-ac66-6f9fd286b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:41.929534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f3516-1c8c-41b9-ac66-6f9fd286b0b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:41.930282 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f3516-1c8c-41b9-ac66-6f9fd286b0b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:41.931669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f3516-1c8c-41b9-ac66-6f9fd286b0b8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:41.953326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 516/1013] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 4 18:44:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:42.009980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f246f6-d6c2-40ff-baff-6a7c0f602a03 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.010172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f246f6-d6c2-40ff-baff-6a7c0f602a03 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.010472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f246f6-d6c2-40ff-baff-6a7c0f602a03 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.011958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 498/1014] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:42.018006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344996a-7960-4b56-b61e-f4572f5a6158 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.018261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344996a-7960-4b56-b61e-f4572f5a6158 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.018517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344996a-7960-4b56-b61e-f4572f5a6158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.036436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5344996a-7960-4b56-b61e-f4572f5a6158 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:42.037683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5344996a-7960-4b56-b61e-f4572f5a6158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:42.113576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 517/1015] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:42 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:42.137845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f246f6-d6c2-40ff-baff-6a7c0f602a03 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:42.241366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f246f6-d6c2-40ff-baff-6a7c0f602a03 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:42.274420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569edb41-5a2e-43f5-87a0-742f4cbdd8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:42.275196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569edb41-5a2e-43f5-87a0-742f4cbdd8a8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.275451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569edb41-5a2e-43f5-87a0-742f4cbdd8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.275740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569edb41-5a2e-43f5-87a0-742f4cbdd8a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.286472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569edb41-5a2e-43f5-87a0-742f4cbdd8a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-569edb41-5a2e-43f5-87a0-742f4cbdd8a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:42.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:42.295604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:42.296448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 499/1016] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 4 18:44:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:42.301689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344996a-7960-4b56-b61e-f4572f5a6158 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:42.394377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344996a-7960-4b56-b61e-f4572f5a6158 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:42.425782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275661f-67c9-4ae8-b182-9a685ff842f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:42.426446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275661f-67c9-4ae8-b182-9a685ff842f2 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.426722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275661f-67c9-4ae8-b182-9a685ff842f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.426992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275661f-67c9-4ae8-b182-9a685ff842f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.427742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275661f-67c9-4ae8-b182-9a685ff842f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:42.428040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275661f-67c9-4ae8-b182-9a685ff842f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:42.429427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275661f-67c9-4ae8-b182-9a685ff842f2 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:42.437340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 518/1017] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 4 18:44:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:42.446321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569edb41-5a2e-43f5-87a0-742f4cbdd8a8 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:42.545164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569edb41-5a2e-43f5-87a0-742f4cbdd8a8 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:42.579938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42389f9-fb89-41cc-bc74-92ca72db6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:42.580752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42389f9-fb89-41cc-bc74-92ca72db6825 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.581032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42389f9-fb89-41cc-bc74-92ca72db6825 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.581318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42389f9-fb89-41cc-bc74-92ca72db6825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.591166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42389f9-fb89-41cc-bc74-92ca72db6825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:42.592598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42389f9-fb89-41cc-bc74-92ca72db6825 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-e42389f9-fb89-41cc-bc74-92ca72db6825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:42.609790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:42.610724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:42.616578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:42.616578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:42.616578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:42.616578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:42.616578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 500/1018] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:42.618487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275661f-67c9-4ae8-b182-9a685ff842f2 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:42.704930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594608b-9013-4303-8ebf-db1a1f5e99a9 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.705234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594608b-9013-4303-8ebf-db1a1f5e99a9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.705530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594608b-9013-4303-8ebf-db1a1f5e99a9 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.707199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 501/1019] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:42.712212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee7d41-b96e-4cf3-a5a7-3a7675490e3f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.712580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee7d41-b96e-4cf3-a5a7-3a7675490e3f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.712920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee7d41-b96e-4cf3-a5a7-3a7675490e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.721332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275661f-67c9-4ae8-b182-9a685ff842f2 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:42.730075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a0ee7d41-b96e-4cf3-a5a7-3a7675490e3f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:42.731336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a0ee7d41-b96e-4cf3-a5a7-3a7675490e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:42.754185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a790d9-bd54-4e68-80be-67591a9cc5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:42.755023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a790d9-bd54-4e68-80be-67591a9cc5c9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.755301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a790d9-bd54-4e68-80be-67591a9cc5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.755888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a790d9-bd54-4e68-80be-67591a9cc5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.756875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a790d9-bd54-4e68-80be-67591a9cc5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:42.757181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a790d9-bd54-4e68-80be-67591a9cc5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:42.759058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a790d9-bd54-4e68-80be-67591a9cc5c9 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:42.776655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 519/1020] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:42.777688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a790d9-bd54-4e68-80be-67591a9cc5c9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:42.800298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 502/1021] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:42 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:42.822404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee7d41-b96e-4cf3-a5a7-3a7675490e3f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:42.871792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a790d9-bd54-4e68-80be-67591a9cc5c9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:42.903357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6aa1-b222-4ecc-b658-f5c61b10c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:42.904138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6aa1-b222-4ecc-b658-f5c61b10c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.904416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6aa1-b222-4ecc-b658-f5c61b10c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.904683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6aa1-b222-4ecc-b658-f5c61b10c7f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.911418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d6aa1-b222-4ecc-b658-f5c61b10c7f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:42.912838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d6aa1-b222-4ecc-b658-f5c61b10c7f3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:42.914522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee7d41-b96e-4cf3-a5a7-3a7675490e3f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-1d0d6aa1-b222-4ecc-b658-f5c61b10c7f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:42.927256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:42.928498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:42.929824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 520/1022] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 4 18:44:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:42.936604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6aa1-b222-4ecc-b658-f5c61b10c7f3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:42.955464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920da1a1-8559-4010-885a-2517ac334c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:42.956153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920da1a1-8559-4010-885a-2517ac334c46 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:42.956436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920da1a1-8559-4010-885a-2517ac334c46 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:42.956712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920da1a1-8559-4010-885a-2517ac334c46 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:42.957474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920da1a1-8559-4010-885a-2517ac334c46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:42.958902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920da1a1-8559-4010-885a-2517ac334c46 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:42.972880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 503/1023] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:44:42 2022] POST /identity/v3/services => generated 242 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:44:43.044464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6aa1-b222-4ecc-b658-f5c61b10c7f3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:43.088658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a0531-f57c-41cf-9e91-309583ec5c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:43.089273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a0531-f57c-41cf-9e91-309583ec5c84 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:43.089584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a0531-f57c-41cf-9e91-309583ec5c84 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:43.089853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a0531-f57c-41cf-9e91-309583ec5c84 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:43.090729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a0531-f57c-41cf-9e91-309583ec5c84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:43.091040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a0531-f57c-41cf-9e91-309583ec5c84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:43.092517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a0531-f57c-41cf-9e91-309583ec5c84 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:43.111724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 521/1024] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 4 18:44:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:43.117569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920da1a1-8559-4010-885a-2517ac334c46 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:43.217976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920da1a1-8559-4010-885a-2517ac334c46 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:43.250107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4bc3a-d723-4717-9feb-586d9f540dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:43.250757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4bc3a-d723-4717-9feb-586d9f540dab None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:43.251030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4bc3a-d723-4717-9feb-586d9f540dab None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:43.251298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4bc3a-d723-4717-9feb-586d9f540dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:43.312466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4bc3a-d723-4717-9feb-586d9f540dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:43.313965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4bc3a-d723-4717-9feb-586d9f540dab None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:43.410433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 504/1025] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:44:43.415897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a0531-f57c-41cf-9e91-309583ec5c84 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:43.513949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a0531-f57c-41cf-9e91-309583ec5c84 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:43.546936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f1da-6407-4916-b92f-a80ff0823983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:43.547727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f1da-6407-4916-b92f-a80ff0823983 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:43.547980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f1da-6407-4916-b92f-a80ff0823983 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:43.548269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f1da-6407-4916-b92f-a80ff0823983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:43.558112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5f1da-6407-4916-b92f-a80ff0823983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:43.559527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5f1da-6407-4916-b92f-a80ff0823983 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-f3e5f1da-6407-4916-b92f-a80ff0823983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:43.578964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:43.579921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:43.580974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:43.580974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:43.580974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:43.580974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:43.584950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 522/1026] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:43.585999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4bc3a-d723-4717-9feb-586d9f540dab None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:43.685690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4bc3a-d723-4717-9feb-586d9f540dab None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:43.719671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a08f4-9d1c-47d5-8869-ba7cc9cab498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:43.720332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a08f4-9d1c-47d5-8869-ba7cc9cab498 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:43.720631 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a08f4-9d1c-47d5-8869-ba7cc9cab498 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:43.720970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a08f4-9d1c-47d5-8869-ba7cc9cab498 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:43.721718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a08f4-9d1c-47d5-8869-ba7cc9cab498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:43.722024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a08f4-9d1c-47d5-8869-ba7cc9cab498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:43.723368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a08f4-9d1c-47d5-8869-ba7cc9cab498 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:43.734410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 505/1027] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:43.739807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f1da-6407-4916-b92f-a80ff0823983 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:43.835023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f1da-6407-4916-b92f-a80ff0823983 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:43.868259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed5bc8-1336-4cb1-baa6-aa6c20ba1ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:43.869058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed5bc8-1336-4cb1-baa6-aa6c20ba1ff2 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:43.869325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed5bc8-1336-4cb1-baa6-aa6c20ba1ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:43.869631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed5bc8-1336-4cb1-baa6-aa6c20ba1ff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:43.876844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed5bc8-1336-4cb1-baa6-aa6c20ba1ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:43.878329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed5bc8-1336-4cb1-baa6-aa6c20ba1ff2 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-30ed5bc8-1336-4cb1-baa6-aa6c20ba1ff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:43.892161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:43.893112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:43.898942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:43.898942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:43.898942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:43.898942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:43.898942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:43.898942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:43.898942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:43.898942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:43.898942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 523/1028] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:43.899446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a08f4-9d1c-47d5-8869-ba7cc9cab498 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:43.996998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a08f4-9d1c-47d5-8869-ba7cc9cab498 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:44.032897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97b2d5-78c0-4bef-9d88-8526c1372dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:44.033685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b2d5-78c0-4bef-9d88-8526c1372dd9 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:44.033963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b2d5-78c0-4bef-9d88-8526c1372dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:44.034226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b2d5-78c0-4bef-9d88-8526c1372dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:44.035032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97b2d5-78c0-4bef-9d88-8526c1372dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:44.035339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97b2d5-78c0-4bef-9d88-8526c1372dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:44.036799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97b2d5-78c0-4bef-9d88-8526c1372dd9 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:44.050428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 506/1029] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:44.056435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed5bc8-1336-4cb1-baa6-aa6c20ba1ff2 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:44.155023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed5bc8-1336-4cb1-baa6-aa6c20ba1ff2 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:44.188499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3050475-38bc-4b07-99d3-427fb6e6b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:44.189154 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050475-38bc-4b07-99d3-427fb6e6b304 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:44.189518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050475-38bc-4b07-99d3-427fb6e6b304 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:44.189790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050475-38bc-4b07-99d3-427fb6e6b304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:44.190620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3050475-38bc-4b07-99d3-427fb6e6b304 None admin] RBAC: Adding query filter params (role.id=a6441f8a929f4bcd82b2c8fc4402e2f1, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=3938216005694c45bd6126415930d014) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:44.190927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3050475-38bc-4b07-99d3-427fb6e6b304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:44.192334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3050475-38bc-4b07-99d3-427fb6e6b304 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:44.197796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 524/1030] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:44 2022] GET /identity/v3/role_assignments?user.id=3938216005694c45bd6126415930d014&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=a6441f8a929f4bcd82b2c8fc4402e2f1 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:44.208172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c583002-a218-4fa2-b659-181f16c2b6a3 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:44.208422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c583002-a218-4fa2-b659-181f16c2b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:44.208730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c583002-a218-4fa2-b659-181f16c2b6a3 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:44.210380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 507/1031] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:44.217338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acf0de-0ce3-4f9c-bae3-2b4132230d60 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:44.217338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acf0de-0ce3-4f9c-bae3-2b4132230d60 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:44.217338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acf0de-0ce3-4f9c-bae3-2b4132230d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:44.235225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-41acf0de-0ce3-4f9c-bae3-2b4132230d60 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:44.236563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-41acf0de-0ce3-4f9c-bae3-2b4132230d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:44.308564 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 525/1032] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:44.336256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c583002-a218-4fa2-b659-181f16c2b6a3 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:44.438827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c583002-a218-4fa2-b659-181f16c2b6a3 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:44.476212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc999d9-bedf-4751-8d1c-131ec61aeedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:44.477343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc999d9-bedf-4751-8d1c-131ec61aeedd None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:44.477813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc999d9-bedf-4751-8d1c-131ec61aeedd None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:44.478277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc999d9-bedf-4751-8d1c-131ec61aeedd None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:44.479911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc999d9-bedf-4751-8d1c-131ec61aeedd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:44.481545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc999d9-bedf-4751-8d1c-131ec61aeedd None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:44.483776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 508/1033] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:44.489360 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acf0de-0ce3-4f9c-bae3-2b4132230d60 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:44.586926 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acf0de-0ce3-4f9c-bae3-2b4132230d60 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:44.620636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e4af7-cbd2-46a6-8d67-c5a5ad8d23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:44.621247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e4af7-cbd2-46a6-8d67-c5a5ad8d23b6 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:44.621556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e4af7-cbd2-46a6-8d67-c5a5ad8d23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:44.621833 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e4af7-cbd2-46a6-8d67-c5a5ad8d23b6 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:44.622540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e4af7-cbd2-46a6-8d67-c5a5ad8d23b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:44.624286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e4af7-cbd2-46a6-8d67-c5a5ad8d23b6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:44.651414 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 526/1034] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:44:44 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:45.283429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36d24c-fe9a-4866-ac27-28b5ab3b0895 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:45.283983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36d24c-fe9a-4866-ac27-28b5ab3b0895 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:45.283983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36d24c-fe9a-4866-ac27-28b5ab3b0895 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:45.285513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 509/1035] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:45.290825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad7b4-b586-444f-88a5-9d7175076048 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:45.291148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad7b4-b586-444f-88a5-9d7175076048 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:45.291446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad7b4-b586-444f-88a5-9d7175076048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:45.309697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-472ad7b4-b586-444f-88a5-9d7175076048 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:45.310926 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-472ad7b4-b586-444f-88a5-9d7175076048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:45.380514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 527/1036] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:45.403816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36d24c-fe9a-4866-ac27-28b5ab3b0895 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:45.512237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36d24c-fe9a-4866-ac27-28b5ab3b0895 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:45.545155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cede483-b190-4762-9671-9d99a362bb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:45.545959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cede483-b190-4762-9671-9d99a362bb67 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:45.546249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cede483-b190-4762-9671-9d99a362bb67 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:45.546525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cede483-b190-4762-9671-9d99a362bb67 None admin] PATH_INFO: `/v3/services/image` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:45.547182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cede483-b190-4762-9671-9d99a362bb67 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:45.548553 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cede483-b190-4762-9671-9d99a362bb67 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8cede483-b190-4762-9671-9d99a362bb67 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:45.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:45.561110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:45.566257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 510/1037] 10.222.0.35 () {56 vars in 1105 bytes} [Wed May 4 18:44:45 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:45.569522 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ad7b4-b586-444f-88a5-9d7175076048 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:45.665862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ad7b4-b586-444f-88a5-9d7175076048 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:45.699128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24ccc1-0d4d-4aaa-8186-66bf457c03ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:45.699795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24ccc1-0d4d-4aaa-8186-66bf457c03ac None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:45.700037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24ccc1-0d4d-4aaa-8186-66bf457c03ac None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:45.700342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24ccc1-0d4d-4aaa-8186-66bf457c03ac None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:45.701055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24ccc1-0d4d-4aaa-8186-66bf457c03ac None admin] RBAC: Adding query filter params (name=image) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:45.701390 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24ccc1-0d4d-4aaa-8186-66bf457c03ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:45.702756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24ccc1-0d4d-4aaa-8186-66bf457c03ac None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:45.707978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 528/1038] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:45.713813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cede483-b190-4762-9671-9d99a362bb67 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:45.816912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cede483-b190-4762-9671-9d99a362bb67 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:45.851668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a95b-3825-4814-9a51-2c89fd060912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:45.852338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a95b-3825-4814-9a51-2c89fd060912 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:45.852623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a95b-3825-4814-9a51-2c89fd060912 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:45.852899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a95b-3825-4814-9a51-2c89fd060912 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:45.853644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4a95b-3825-4814-9a51-2c89fd060912 None admin] RBAC: Adding query filter params (type=image) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:45.853956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4a95b-3825-4814-9a51-2c89fd060912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:45.855315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4a95b-3825-4814-9a51-2c89fd060912 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:45.860255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 511/1039] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:45.866187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24ccc1-0d4d-4aaa-8186-66bf457c03ac None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:45.963042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24ccc1-0d4d-4aaa-8186-66bf457c03ac None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:45.996130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a912e60-d2e7-45f9-a82e-bd15cfadb0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:45.996857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912e60-d2e7-45f9-a82e-bd15cfadb0ad None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:45.997140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912e60-d2e7-45f9-a82e-bd15cfadb0ad None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:45.997453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912e60-d2e7-45f9-a82e-bd15cfadb0ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:45.998245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a912e60-d2e7-45f9-a82e-bd15cfadb0ad None admin] RBAC: Adding query filter params (interface=public, service_id=495e38ed123740ae91b007865752851d, region_id=RegionOne) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:45.998556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a912e60-d2e7-45f9-a82e-bd15cfadb0ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:46.000244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a912e60-d2e7-45f9-a82e-bd15cfadb0ad None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:46.006472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 529/1040] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 4 18:44:45 2022] GET /identity/v3/endpoints?service_id=495e38ed123740ae91b007865752851d&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:46.011127 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a95b-3825-4814-9a51-2c89fd060912 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:46.111094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a95b-3825-4814-9a51-2c89fd060912 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:46.145407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055afbc-949b-4ac9-a188-a9c93581bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:46.146077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055afbc-949b-4ac9-a188-a9c93581bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:46.146358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055afbc-949b-4ac9-a188-a9c93581bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:46.146630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055afbc-949b-4ac9-a188-a9c93581bdc7 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:46.147312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055afbc-949b-4ac9-a188-a9c93581bdc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:46.148671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055afbc-949b-4ac9-a188-a9c93581bdc7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:46.161392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 512/1041] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 4 18:44:46 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:44:46.425670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d056-acd8-4edc-a4d3-c0e973b410c4 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:46.425859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d056-acd8-4edc-a4d3-c0e973b410c4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:46.426130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d056-acd8-4edc-a4d3-c0e973b410c4 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:46.427533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 530/1042] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:46.432889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ccd34-5817-47a4-884c-c76ccb5b572f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:46.433410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ccd34-5817-47a4-884c-c76ccb5b572f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:46.433489 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ccd34-5817-47a4-884c-c76ccb5b572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:46.450848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0f0ccd34-5817-47a4-884c-c76ccb5b572f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:46.454665 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0f0ccd34-5817-47a4-884c-c76ccb5b572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:46.520666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 513/1043] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:46.543242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d056-acd8-4edc-a4d3-c0e973b410c4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:46.643593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d056-acd8-4edc-a4d3-c0e973b410c4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:46.675538 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9f0bf-fbb1-45cf-80da-e43443c36b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:46.676397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9f0bf-fbb1-45cf-80da-e43443c36b86 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:46.676599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9f0bf-fbb1-45cf-80da-e43443c36b86 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:46.676878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9f0bf-fbb1-45cf-80da-e43443c36b86 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:46.686425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9f0bf-fbb1-45cf-80da-e43443c36b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-68a9f0bf-fbb1-45cf-80da-e43443c36b86 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:46.694398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:46.695322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:46.696699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:46.700742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 531/1044] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 4 18:44:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:46.704355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ccd34-5817-47a4-884c-c76ccb5b572f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:46.807767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ccd34-5817-47a4-884c-c76ccb5b572f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:46.843333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80391ccf-8b6c-4714-b571-2c10bca77806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:46.844007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391ccf-8b6c-4714-b571-2c10bca77806 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:46.844285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391ccf-8b6c-4714-b571-2c10bca77806 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:46.844553 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391ccf-8b6c-4714-b571-2c10bca77806 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:46.845316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80391ccf-8b6c-4714-b571-2c10bca77806 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:46.845690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80391ccf-8b6c-4714-b571-2c10bca77806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:46.847043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80391ccf-8b6c-4714-b571-2c10bca77806 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:46.855163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 514/1045] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 4 18:44:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:46.860845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9f0bf-fbb1-45cf-80da-e43443c36b86 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:46.934022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2499-65ab-4675-b8c7-d44774076d3d None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:46.934207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2499-65ab-4675-b8c7-d44774076d3d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:46.934453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2499-65ab-4675-b8c7-d44774076d3d None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:46.936017 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 515/1046] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:44:46.940959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724b683-0190-4ef8-a571-16131de9aa51 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:46.941249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724b683-0190-4ef8-a571-16131de9aa51 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:46.941634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724b683-0190-4ef8-a571-16131de9aa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:46.958498 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3724b683-0190-4ef8-a571-16131de9aa51 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:46.959051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9f0bf-fbb1-45cf-80da-e43443c36b86 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:46.959664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3724b683-0190-4ef8-a571-16131de9aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:46.991556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148617a-fa0d-40f8-b5c6-3059167ede8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:46.992354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148617a-fa0d-40f8-b5c6-3059167ede8b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:46.992625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148617a-fa0d-40f8-b5c6-3059167ede8b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:46.992891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148617a-fa0d-40f8-b5c6-3059167ede8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:47.004794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148617a-fa0d-40f8-b5c6-3059167ede8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:47.006344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148617a-fa0d-40f8-b5c6-3059167ede8b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:47.026721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 516/1047] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-9148617a-fa0d-40f8-b5c6-3059167ede8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:47.028700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:47.029610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:47.035719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:47.035719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:47.035719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:47.035719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:47.035719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 532/1048] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:47.037114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724b683-0190-4ef8-a571-16131de9aa51 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:47.050732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148617a-fa0d-40f8-b5c6-3059167ede8b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:47.132849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724b683-0190-4ef8-a571-16131de9aa51 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:47.145550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148617a-fa0d-40f8-b5c6-3059167ede8b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:47.164648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076f1f0-9190-4730-bc42-5c1dde731cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:47.166511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f1f0-9190-4730-bc42-5c1dde731cef None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:47.166511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f1f0-9190-4730-bc42-5c1dde731cef None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:47.166511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f1f0-9190-4730-bc42-5c1dde731cef None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:47.168017 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f1f0-9190-4730-bc42-5c1dde731cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:47.168328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f1f0-9190-4730-bc42-5c1dde731cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:47.169731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f1f0-9190-4730-bc42-5c1dde731cef None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:47.179384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91f77a-7227-4138-a171-148e9286285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:47.180183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91f77a-7227-4138-a171-148e9286285a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:47.180467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91f77a-7227-4138-a171-148e9286285a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:47.180744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91f77a-7227-4138-a171-148e9286285a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:47.185455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 517/1049] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:47.185585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91f77a-7227-4138-a171-148e9286285a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:47.185585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91f77a-7227-4138-a171-148e9286285a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:47.185585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 533/1050] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:47.186512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076f1f0-9190-4730-bc42-5c1dde731cef None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:47.190334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91f77a-7227-4138-a171-148e9286285a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:47.280863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076f1f0-9190-4730-bc42-5c1dde731cef None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:47.287834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91f77a-7227-4138-a171-148e9286285a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:47.316093 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7830f-bcf4-4247-86b2-41bc2932bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:47.316897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7830f-bcf4-4247-86b2-41bc2932bbdd None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:47.317164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7830f-bcf4-4247-86b2-41bc2932bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:47.317493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7830f-bcf4-4247-86b2-41bc2932bbdd None admin] PATH_INFO: `/v3/users/nova` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:47.323265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594ea70-c8d5-4f1b-b53d-c35222aa8d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:47.324170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594ea70-c8d5-4f1b-b53d-c35222aa8d16 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:47.324598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594ea70-c8d5-4f1b-b53d-c35222aa8d16 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:47.325005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594ea70-c8d5-4f1b-b53d-c35222aa8d16 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:47.326066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594ea70-c8d5-4f1b-b53d-c35222aa8d16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:47.326181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7830f-bcf4-4247-86b2-41bc2932bbdd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:47.327541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7830f-bcf4-4247-86b2-41bc2932bbdd None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:47.327997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594ea70-c8d5-4f1b-b53d-c35222aa8d16 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-94f7830f-bcf4-4247-86b2-41bc2932bbdd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:47.342318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:47.343450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:47.344446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 518/1051] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 4 18:44:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:47.349833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7830f-bcf4-4247-86b2-41bc2932bbdd None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:47.353089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 534/1052] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:44:47 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:44:47.466546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7830f-bcf4-4247-86b2-41bc2932bbdd None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:47.500443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236296c-bfe8-4f49-ba51-e55ac058decf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:47.501121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236296c-bfe8-4f49-ba51-e55ac058decf None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:47.501429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236296c-bfe8-4f49-ba51-e55ac058decf None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:47.501744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236296c-bfe8-4f49-ba51-e55ac058decf None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:47.503064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236296c-bfe8-4f49-ba51-e55ac058decf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:47.503370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236296c-bfe8-4f49-ba51-e55ac058decf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:47.504801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236296c-bfe8-4f49-ba51-e55ac058decf None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:47.523936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 519/1053] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 4 18:44:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:47.529595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594ea70-c8d5-4f1b-b53d-c35222aa8d16 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:47.631780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594ea70-c8d5-4f1b-b53d-c35222aa8d16 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:47.664896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853b008-6ae2-44e1-a986-43bf55c23958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:47.665747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b008-6ae2-44e1-a986-43bf55c23958 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:47.666039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b008-6ae2-44e1-a986-43bf55c23958 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:47.666301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b008-6ae2-44e1-a986-43bf55c23958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:47.677765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853b008-6ae2-44e1-a986-43bf55c23958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:47.679436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853b008-6ae2-44e1-a986-43bf55c23958 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-b853b008-6ae2-44e1-a986-43bf55c23958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:47.696734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:47.697802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:47.698720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:47.698720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:47.698720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:47.698720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:47.699046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 535/1054] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:47.704383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236296c-bfe8-4f49-ba51-e55ac058decf None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:47.800676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236296c-bfe8-4f49-ba51-e55ac058decf None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:47.834630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30582c9f-f4fc-4695-9d4d-abb6c4312d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:47.835447 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30582c9f-f4fc-4695-9d4d-abb6c4312d3d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:47.835826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30582c9f-f4fc-4695-9d4d-abb6c4312d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:47.836195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30582c9f-f4fc-4695-9d4d-abb6c4312d3d None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:47.837044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30582c9f-f4fc-4695-9d4d-abb6c4312d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:47.837485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30582c9f-f4fc-4695-9d4d-abb6c4312d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:47.838942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30582c9f-f4fc-4695-9d4d-abb6c4312d3d None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:47.850775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 520/1055] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:47.862994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853b008-6ae2-44e1-a986-43bf55c23958 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:47.961671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853b008-6ae2-44e1-a986-43bf55c23958 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:47.994209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f007c-f3ba-43aa-abf5-40fc2ed0bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:47.995128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f007c-f3ba-43aa-abf5-40fc2ed0bb6d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:47.995497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f007c-f3ba-43aa-abf5-40fc2ed0bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:47.995883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f007c-f3ba-43aa-abf5-40fc2ed0bb6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:48.002879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f007c-f3ba-43aa-abf5-40fc2ed0bb6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:48.004411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f007c-f3ba-43aa-abf5-40fc2ed0bb6d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-b12f007c-f3ba-43aa-abf5-40fc2ed0bb6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:48.018682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:48.019818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:48.020943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:48.020943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:48.020943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:48.020943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:48.020943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:48.020943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:48.020943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:48.020943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:48.022504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 536/1056] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:48.028355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30582c9f-f4fc-4695-9d4d-abb6c4312d3d None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:48.126997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30582c9f-f4fc-4695-9d4d-abb6c4312d3d None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:48.159889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67292f7-b858-4b40-99ec-9db24b395633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:48.160542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67292f7-b858-4b40-99ec-9db24b395633 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:48.160814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67292f7-b858-4b40-99ec-9db24b395633 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:48.161078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67292f7-b858-4b40-99ec-9db24b395633 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:48.161900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67292f7-b858-4b40-99ec-9db24b395633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:48.162204 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67292f7-b858-4b40-99ec-9db24b395633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:48.163610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67292f7-b858-4b40-99ec-9db24b395633 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:48.175596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 521/1057] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:48.181579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f007c-f3ba-43aa-abf5-40fc2ed0bb6d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:48.287015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f007c-f3ba-43aa-abf5-40fc2ed0bb6d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:48.321143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609851e-44f9-48df-96c7-34adab1a7187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:48.322050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609851e-44f9-48df-96c7-34adab1a7187 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:48.322327 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609851e-44f9-48df-96c7-34adab1a7187 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:48.322677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609851e-44f9-48df-96c7-34adab1a7187 None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/3938216005694c45bd6126415930d014/roles/a6441f8a929f4bcd82b2c8fc4402e2f1` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:48.324762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609851e-44f9-48df-96c7-34adab1a7187 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=3938216005694c45bd6126415930d014, role_id=a6441f8a929f4bcd82b2c8fc4402e2f1)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:48.326216 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609851e-44f9-48df-96c7-34adab1a7187 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:48.339740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 537/1058] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:44:48 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/3938216005694c45bd6126415930d014/roles/a6441f8a929f4bcd82b2c8fc4402e2f1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:44:48.445349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2e261-71b6-4af9-b8f8-d5845a136ff4 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:48.445678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2e261-71b6-4af9-b8f8-d5845a136ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:48.445843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2e261-71b6-4af9-b8f8-d5845a136ff4 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:48.447597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 522/1059] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:48.455170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a186e-8d47-40b6-a8cb-b228370f0ca8 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:48.455170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a186e-8d47-40b6-a8cb-b228370f0ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:48.455170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a186e-8d47-40b6-a8cb-b228370f0ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:48.472163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-890a186e-8d47-40b6-a8cb-b228370f0ca8 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:48.473425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-890a186e-8d47-40b6-a8cb-b228370f0ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:48.544962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 538/1060] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:48.569068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2e261-71b6-4af9-b8f8-d5845a136ff4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:48.670234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2e261-71b6-4af9-b8f8-d5845a136ff4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:48.704918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120e99-03d2-4c7c-9f5b-706e87e9e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:48.705693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120e99-03d2-4c7c-9f5b-706e87e9e7eb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:48.705967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120e99-03d2-4c7c-9f5b-706e87e9e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:48.706236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120e99-03d2-4c7c-9f5b-706e87e9e7eb None admin] PATH_INFO: `/v3/services/image` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:48.706887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81120e99-03d2-4c7c-9f5b-706e87e9e7eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:48.708280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81120e99-03d2-4c7c-9f5b-706e87e9e7eb None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-81120e99-03d2-4c7c-9f5b-706e87e9e7eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:48.719738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:48.720749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:48.721671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 523/1061] 10.222.0.35 () {56 vars in 1105 bytes} [Wed May 4 18:44:48 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:48.728824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a186e-8d47-40b6-a8cb-b228370f0ca8 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:48.824050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a186e-8d47-40b6-a8cb-b228370f0ca8 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:48.856997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b25df-c83a-4e5a-99d6-f9f96c0a6594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:48.857687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b25df-c83a-4e5a-99d6-f9f96c0a6594 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:48.857968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b25df-c83a-4e5a-99d6-f9f96c0a6594 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:48.858240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b25df-c83a-4e5a-99d6-f9f96c0a6594 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:48.858947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b25df-c83a-4e5a-99d6-f9f96c0a6594 None admin] RBAC: Adding query filter params (name=image) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:48.859248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b25df-c83a-4e5a-99d6-f9f96c0a6594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:48.860604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b25df-c83a-4e5a-99d6-f9f96c0a6594 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:48.871798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 539/1062] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:48.871928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120e99-03d2-4c7c-9f5b-706e87e9e7eb None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:48.974200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120e99-03d2-4c7c-9f5b-706e87e9e7eb None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:49.008235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924b80-6489-411b-94be-c5854f9fef3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:49.008911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924b80-6489-411b-94be-c5854f9fef3b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:49.009192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924b80-6489-411b-94be-c5854f9fef3b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:49.009503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924b80-6489-411b-94be-c5854f9fef3b None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:49.010217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924b80-6489-411b-94be-c5854f9fef3b None admin] RBAC: Adding query filter params (type=image) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:49.010524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924b80-6489-411b-94be-c5854f9fef3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:49.011883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924b80-6489-411b-94be-c5854f9fef3b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:49.016978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 524/1063] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:49.022902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b25df-c83a-4e5a-99d6-f9f96c0a6594 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:49.119870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b25df-c83a-4e5a-99d6-f9f96c0a6594 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:49.154362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc3b98-2d3d-41d3-82a2-d7c6237d5b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:49.155026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc3b98-2d3d-41d3-82a2-d7c6237d5b17 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:49.155309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc3b98-2d3d-41d3-82a2-d7c6237d5b17 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:49.155584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc3b98-2d3d-41d3-82a2-d7c6237d5b17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:49.156332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc3b98-2d3d-41d3-82a2-d7c6237d5b17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:49.157734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc3b98-2d3d-41d3-82a2-d7c6237d5b17 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:49.177384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 540/1064] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 4 18:44:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:44:49.691313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd2144-06f8-4293-bab8-ea36726e252e None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:49.691858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd2144-06f8-4293-bab8-ea36726e252e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:49.691858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd2144-06f8-4293-bab8-ea36726e252e None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:49.693418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 525/1065] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:49.698499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a4c6-b4b1-47c2-b77c-4ffee1660a73 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:49.698754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a4c6-b4b1-47c2-b77c-4ffee1660a73 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:49.699064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a4c6-b4b1-47c2-b77c-4ffee1660a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:49.715925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6160a4c6-b4b1-47c2-b77c-4ffee1660a73 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:49.717023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6160a4c6-b4b1-47c2-b77c-4ffee1660a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:49.790150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 541/1066] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:49.813005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd2144-06f8-4293-bab8-ea36726e252e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:49.912739 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd2144-06f8-4293-bab8-ea36726e252e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:49.946283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b265b82-4b79-406b-a91f-96bb9528c328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:49.947086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b265b82-4b79-406b-a91f-96bb9528c328 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:49.947367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b265b82-4b79-406b-a91f-96bb9528c328 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:49.947694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b265b82-4b79-406b-a91f-96bb9528c328 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:49.958253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b265b82-4b79-406b-a91f-96bb9528c328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-9b265b82-4b79-406b-a91f-96bb9528c328 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:49.965800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:49.966845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:49.973316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 526/1067] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:49.974037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160a4c6-b4b1-47c2-b77c-4ffee1660a73 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:50.070053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160a4c6-b4b1-47c2-b77c-4ffee1660a73 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:50.103949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d4b2e-d716-4bdf-8705-add774f949d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:50.104915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d4b2e-d716-4bdf-8705-add774f949d8 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:50.105402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d4b2e-d716-4bdf-8705-add774f949d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:50.105848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d4b2e-d716-4bdf-8705-add774f949d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:50.106766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d4b2e-d716-4bdf-8705-add774f949d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:50.107217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d4b2e-d716-4bdf-8705-add774f949d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:50.108725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d4b2e-d716-4bdf-8705-add774f949d8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:50.121867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 542/1068] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:50.123199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b265b82-4b79-406b-a91f-96bb9528c328 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:50.221091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b265b82-4b79-406b-a91f-96bb9528c328 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:50.255131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afdc23-2dae-4c84-b2fd-bb373a89626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:50.256275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afdc23-2dae-4c84-b2fd-bb373a89626c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:50.256697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afdc23-2dae-4c84-b2fd-bb373a89626c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:50.257112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afdc23-2dae-4c84-b2fd-bb373a89626c None admin] PATH_INFO: `/v3/users/2aa43868d0ae47919b2a0c2d637ede4f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:50.270501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afdc23-2dae-4c84-b2fd-bb373a89626c None admin] RBAC: Authorizing `identity:get_user(user_id=2aa43868d0ae47919b2a0c2d637ede4f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:50.272113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afdc23-2dae-4c84-b2fd-bb373a89626c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:50.278530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 527/1069] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:44:50 2022] GET /identity/v3/users/2aa43868d0ae47919b2a0c2d637ede4f => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:50.279765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d4b2e-d716-4bdf-8705-add774f949d8 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:50.379155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d4b2e-d716-4bdf-8705-add774f949d8 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:50.416682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7265591-cf9b-4efd-8b85-34dbb16e9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:50.417339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265591-cf9b-4efd-8b85-34dbb16e9eaa None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:50.417626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265591-cf9b-4efd-8b85-34dbb16e9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:50.417899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265591-cf9b-4efd-8b85-34dbb16e9eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:50.485083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7265591-cf9b-4efd-8b85-34dbb16e9eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:50.486493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7265591-cf9b-4efd-8b85-34dbb16e9eaa None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:50.571261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cd726-eb12-4ca8-a3dc-c0e3944499a8 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:50.571551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cd726-eb12-4ca8-a3dc-c0e3944499a8 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:50.571966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cd726-eb12-4ca8-a3dc-c0e3944499a8 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:50.573457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 528/1070] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:50.578261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec30830-9ffe-4d0b-a187-9c0292513315 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:50.578534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec30830-9ffe-4d0b-a187-9c0292513315 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:50.578806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec30830-9ffe-4d0b-a187-9c0292513315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:50.583170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 543/1071] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:44:50.588978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7265591-cf9b-4efd-8b85-34dbb16e9eaa None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:50.595979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-aec30830-9ffe-4d0b-a187-9c0292513315 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:50.597147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-aec30830-9ffe-4d0b-a187-9c0292513315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:50.664616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 529/1072] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:50.684479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7265591-cf9b-4efd-8b85-34dbb16e9eaa None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:50.687059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec30830-9ffe-4d0b-a187-9c0292513315 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:50.718061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5259636-8be2-4a06-9284-ce585c74da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:50.718916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5259636-8be2-4a06-9284-ce585c74da2c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:50.719186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5259636-8be2-4a06-9284-ce585c74da2c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:50.719450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5259636-8be2-4a06-9284-ce585c74da2c None admin] PATH_INFO: `/v3/projects/2367a0dfe644410ea8fb6fef52411d8d` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:50.720654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5259636-8be2-4a06-9284-ce585c74da2c None admin] RBAC: Authorizing `identity:get_project(project_id=2367a0dfe644410ea8fb6fef52411d8d)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:50.722105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5259636-8be2-4a06-9284-ce585c74da2c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:50.723939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 544/1073] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:44:50 2022] GET /identity/v3/projects/2367a0dfe644410ea8fb6fef52411d8d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:50.729791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5259636-8be2-4a06-9284-ce585c74da2c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:50.782123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec30830-9ffe-4d0b-a187-9c0292513315 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:50.814091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ce7c5-9c5e-42ed-8582-9b87aa9cac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:50.814939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ce7c5-9c5e-42ed-8582-9b87aa9cac5f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:50.815216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ce7c5-9c5e-42ed-8582-9b87aa9cac5f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:50.815485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ce7c5-9c5e-42ed-8582-9b87aa9cac5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:50.824954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5259636-8be2-4a06-9284-ce585c74da2c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:50.826020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ce7c5-9c5e-42ed-8582-9b87aa9cac5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-aa1ce7c5-9c5e-42ed-8582-9b87aa9cac5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:50.834284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:50.835235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:50.836118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 530/1074] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 4 18:44:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:50.841404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ce7c5-9c5e-42ed-8582-9b87aa9cac5f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:50.859393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60bd79-9d47-4b82-bf67-6e7b8b6dec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:50.860048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60bd79-9d47-4b82-bf67-6e7b8b6dec3d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:50.860324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60bd79-9d47-4b82-bf67-6e7b8b6dec3d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:50.860591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60bd79-9d47-4b82-bf67-6e7b8b6dec3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:50.861542 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60bd79-9d47-4b82-bf67-6e7b8b6dec3d None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=2367a0dfe644410ea8fb6fef52411d8d, user.id=2aa43868d0ae47919b2a0c2d637ede4f) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:50.861854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60bd79-9d47-4b82-bf67-6e7b8b6dec3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:50.863268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60bd79-9d47-4b82-bf67-6e7b8b6dec3d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:50.877581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 545/1075] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:50 2022] GET /identity/v3/role_assignments?user.id=2aa43868d0ae47919b2a0c2d637ede4f&scope.project.id=2367a0dfe644410ea8fb6fef52411d8d&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:50.941761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ce7c5-9c5e-42ed-8582-9b87aa9cac5f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:50.978662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c2912-6fa0-4927-8307-9d7da485ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:50.979346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c2912-6fa0-4927-8307-9d7da485ffff None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:50.979595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c2912-6fa0-4927-8307-9d7da485ffff None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:50.979897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c2912-6fa0-4927-8307-9d7da485ffff None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:50.980691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c2912-6fa0-4927-8307-9d7da485ffff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:50.980982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c2912-6fa0-4927-8307-9d7da485ffff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:50.982512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c2912-6fa0-4927-8307-9d7da485ffff None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:50.991654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 531/1076] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 4 18:44:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:50.997423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60bd79-9d47-4b82-bf67-6e7b8b6dec3d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:51.100885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60bd79-9d47-4b82-bf67-6e7b8b6dec3d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:51.134918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76822832-16b8-433d-838d-7c5978fc2efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:51.136087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76822832-16b8-433d-838d-7c5978fc2efb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:51.136602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76822832-16b8-433d-838d-7c5978fc2efb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:51.137080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76822832-16b8-433d-838d-7c5978fc2efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:51.147805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76822832-16b8-433d-838d-7c5978fc2efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:51.149239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76822832-16b8-433d-838d-7c5978fc2efb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-76822832-16b8-433d-838d-7c5978fc2efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:51.166648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:51.167610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:51.168613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:51.168613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:51.168613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:51.168613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:51.168613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 546/1077] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:51.176609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c2912-6fa0-4927-8307-9d7da485ffff None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:51.280241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c2912-6fa0-4927-8307-9d7da485ffff None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:51.314705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85dce2-436f-48b6-93e2-b6477e0311d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:51.315443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85dce2-436f-48b6-93e2-b6477e0311d2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:51.315779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85dce2-436f-48b6-93e2-b6477e0311d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:51.316090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85dce2-436f-48b6-93e2-b6477e0311d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:51.316822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85dce2-436f-48b6-93e2-b6477e0311d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:51.317131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85dce2-436f-48b6-93e2-b6477e0311d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:51.318598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85dce2-436f-48b6-93e2-b6477e0311d2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:51.330354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 532/1078] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:51.336283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76822832-16b8-433d-838d-7c5978fc2efb None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:51.438274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76822832-16b8-433d-838d-7c5978fc2efb None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:51.441957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec84862-990d-4039-acbd-60ddb6b66b78 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:51.442482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec84862-990d-4039-acbd-60ddb6b66b78 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:51.442950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec84862-990d-4039-acbd-60ddb6b66b78 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:51.444712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 533/1079] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:51.450048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a782baa-ce60-4e48-946c-bb2746e994db None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:51.450396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a782baa-ce60-4e48-946c-bb2746e994db None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:51.450659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a782baa-ce60-4e48-946c-bb2746e994db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:51.468937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7a782baa-ce60-4e48-946c-bb2746e994db None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:51.470212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7a782baa-ce60-4e48-946c-bb2746e994db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:51.473380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d3e6e-017d-4615-b75c-37dbfa00c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:51.474185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d3e6e-017d-4615-b75c-37dbfa00c940 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:51.474469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d3e6e-017d-4615-b75c-37dbfa00c940 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:51.474744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d3e6e-017d-4615-b75c-37dbfa00c940 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:51.482162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d3e6e-017d-4615-b75c-37dbfa00c940 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:51.483597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d3e6e-017d-4615-b75c-37dbfa00c940 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-981d3e6e-017d-4615-b75c-37dbfa00c940 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:44:51.497721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:51.498665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 18:44:51.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:51.500487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 547/1080] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 4 18:44:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:51.506258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d3e6e-017d-4615-b75c-37dbfa00c940 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:51.541509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 534/1081] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:44:51.563168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a782baa-ce60-4e48-946c-bb2746e994db None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:51.603632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d3e6e-017d-4615-b75c-37dbfa00c940 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:51.638663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4625f69-006e-4a7d-80ba-97a5bf090b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:51.639321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4625f69-006e-4a7d-80ba-97a5bf090b8c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:51.639595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4625f69-006e-4a7d-80ba-97a5bf090b8c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:51.639893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4625f69-006e-4a7d-80ba-97a5bf090b8c None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:51.640706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4625f69-006e-4a7d-80ba-97a5bf090b8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:51.641047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4625f69-006e-4a7d-80ba-97a5bf090b8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:51.642539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4625f69-006e-4a7d-80ba-97a5bf090b8c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:51.660537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a782baa-ce60-4e48-946c-bb2746e994db None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:51.662393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 548/1082] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 4 18:44:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:51.667989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4625f69-006e-4a7d-80ba-97a5bf090b8c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:51.696987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb8395-126f-495a-b6cf-2076d7447217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:51.698001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb8395-126f-495a-b6cf-2076d7447217 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:51.698491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb8395-126f-495a-b6cf-2076d7447217 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:51.698821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb8395-126f-495a-b6cf-2076d7447217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:51.765023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb8395-126f-495a-b6cf-2076d7447217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:51.766858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb8395-126f-495a-b6cf-2076d7447217 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:51.767440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4625f69-006e-4a7d-80ba-97a5bf090b8c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:51.800208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc381a-83f5-4c89-89ac-331ee6d4660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:51.800883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc381a-83f5-4c89-89ac-331ee6d4660f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:51.801163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc381a-83f5-4c89-89ac-331ee6d4660f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:51.801465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc381a-83f5-4c89-89ac-331ee6d4660f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:51.861777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 535/1083] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:44:51.866432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc381a-83f5-4c89-89ac-331ee6d4660f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:51.867527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb8395-126f-495a-b6cf-2076d7447217 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:51.867934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc381a-83f5-4c89-89ac-331ee6d4660f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:51.962253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb8395-126f-495a-b6cf-2076d7447217 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:51.964869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 549/1084] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:44:51.970161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc381a-83f5-4c89-89ac-331ee6d4660f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:51.999447 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d630052-b6e8-487f-a52b-f960acf1ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:52.000252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630052-b6e8-487f-a52b-f960acf1ef96 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:52.000536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630052-b6e8-487f-a52b-f960acf1ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:52.000813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630052-b6e8-487f-a52b-f960acf1ef96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:52.011656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d630052-b6e8-487f-a52b-f960acf1ef96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:52.013119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d630052-b6e8-487f-a52b-f960acf1ef96 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-5d630052-b6e8-487f-a52b-f960acf1ef96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:52.032743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:52.033981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:52.035305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:52.035305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:52.035305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:52.035305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:52.035305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 536/1085] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:52.039961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d630052-b6e8-487f-a52b-f960acf1ef96 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:52.071415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc381a-83f5-4c89-89ac-331ee6d4660f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:52.103402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a65d06-c89b-483c-9200-b72393688642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:52.104186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a65d06-c89b-483c-9200-b72393688642 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:52.104458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a65d06-c89b-483c-9200-b72393688642 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:52.104721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a65d06-c89b-483c-9200-b72393688642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:52.114261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a65d06-c89b-483c-9200-b72393688642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:52.115814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a65d06-c89b-483c-9200-b72393688642 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-42a65d06-c89b-483c-9200-b72393688642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:44:52.132761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:52.133784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:52.134797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:44:52.134797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:44:52.134797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:44:52.134797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:52.137750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 550/1086] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:52.139384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a65d06-c89b-483c-9200-b72393688642 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:52.142911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d630052-b6e8-487f-a52b-f960acf1ef96 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:52.175736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ee949-0413-49a6-8080-058e890fe157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:52.176396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee949-0413-49a6-8080-058e890fe157 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:52.176914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee949-0413-49a6-8080-058e890fe157 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:52.177037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee949-0413-49a6-8080-058e890fe157 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:52.177760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ee949-0413-49a6-8080-058e890fe157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:52.178065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ee949-0413-49a6-8080-058e890fe157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:52.179420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ee949-0413-49a6-8080-058e890fe157 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:52.190414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 537/1087] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:52.237358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a65d06-c89b-483c-9200-b72393688642 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:52.274137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eabfe3-f0fd-420f-a6a2-e12d8a48bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:52.274815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eabfe3-f0fd-420f-a6a2-e12d8a48bafd None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:52.275091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eabfe3-f0fd-420f-a6a2-e12d8a48bafd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:52.275359 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eabfe3-f0fd-420f-a6a2-e12d8a48bafd None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:52.276093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eabfe3-f0fd-420f-a6a2-e12d8a48bafd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:52.276397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eabfe3-f0fd-420f-a6a2-e12d8a48bafd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:52.277810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eabfe3-f0fd-420f-a6a2-e12d8a48bafd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:52.290480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 551/1088] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:44:52.296088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ee949-0413-49a6-8080-058e890fe157 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:52.400029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ee949-0413-49a6-8080-058e890fe157 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:52.437229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c881f45-0456-48b1-8b45-bb7780cb2191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:52.439045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c881f45-0456-48b1-8b45-bb7780cb2191 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:52.439045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c881f45-0456-48b1-8b45-bb7780cb2191 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:52.439045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c881f45-0456-48b1-8b45-bb7780cb2191 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:52.446816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c881f45-0456-48b1-8b45-bb7780cb2191 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:52.448472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c881f45-0456-48b1-8b45-bb7780cb2191 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-6c881f45-0456-48b1-8b45-bb7780cb2191 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:44:52.466475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:52.467410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:52.468362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:44:52.468362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:44:52.468362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:44:52.468362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:44:52.468362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:44:52.468362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:44:52.468362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:44:52.468362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:52.468362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 538/1089] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:44:52.473747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eabfe3-f0fd-420f-a6a2-e12d8a48bafd None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:52.574551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eabfe3-f0fd-420f-a6a2-e12d8a48bafd None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:52.608137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f174a10-f052-4af7-98c1-f2d5008c24a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:52.608832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f174a10-f052-4af7-98c1-f2d5008c24a5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:52.609183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f174a10-f052-4af7-98c1-f2d5008c24a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:52.609488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f174a10-f052-4af7-98c1-f2d5008c24a5 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:52.610318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f174a10-f052-4af7-98c1-f2d5008c24a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:52.610626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f174a10-f052-4af7-98c1-f2d5008c24a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:52.612173 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f174a10-f052-4af7-98c1-f2d5008c24a5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:52.624053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 552/1090] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:52.630307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c881f45-0456-48b1-8b45-bb7780cb2191 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:52.730346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c881f45-0456-48b1-8b45-bb7780cb2191 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:52.766424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172f691-3dda-4fd9-98f3-1103c2375b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:52.767073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f691-3dda-4fd9-98f3-1103c2375b42 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:52.767375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f691-3dda-4fd9-98f3-1103c2375b42 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:52.767651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f691-3dda-4fd9-98f3-1103c2375b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:52.768503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f691-3dda-4fd9-98f3-1103c2375b42 None admin] RBAC: Adding query filter params (role.id=a6441f8a929f4bcd82b2c8fc4402e2f1, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=3938216005694c45bd6126415930d014) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:52.768807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f691-3dda-4fd9-98f3-1103c2375b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:52.770264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f691-3dda-4fd9-98f3-1103c2375b42 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:52.776142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 539/1091] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:52 2022] GET /identity/v3/role_assignments?user.id=3938216005694c45bd6126415930d014&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=a6441f8a929f4bcd82b2c8fc4402e2f1 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:53.105075 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a9985-4833-4873-8092-e75fc030dd72 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:53.105621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a9985-4833-4873-8092-e75fc030dd72 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:53.105709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a9985-4833-4873-8092-e75fc030dd72 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:53.107035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 553/1092] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:53.112879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277a314-7cf3-4ba3-9977-64b78f1ce3bf None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:53.113358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277a314-7cf3-4ba3-9977-64b78f1ce3bf None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:53.113504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277a314-7cf3-4ba3-9977-64b78f1ce3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:53.131218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-e277a314-7cf3-4ba3-9977-64b78f1ce3bf None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:53.132402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e277a314-7cf3-4ba3-9977-64b78f1ce3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:53.200671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 540/1093] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:53.223645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a9985-4833-4873-8092-e75fc030dd72 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:53.323429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a9985-4833-4873-8092-e75fc030dd72 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:53.355665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c3846-f493-47c8-b880-270ff0125653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:53.356383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c3846-f493-47c8-b880-270ff0125653 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:53.356658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c3846-f493-47c8-b880-270ff0125653 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:53.357175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c3846-f493-47c8-b880-270ff0125653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:53.369059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c3846-f493-47c8-b880-270ff0125653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-635c3846-f493-47c8-b880-270ff0125653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:53.377270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:53.378384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:44:53.379251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 554/1094] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:53.384780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277a314-7cf3-4ba3-9977-64b78f1ce3bf None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:53.480358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277a314-7cf3-4ba3-9977-64b78f1ce3bf None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:53.512180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f7e5-e2fc-4e6f-b9b1-06f6c06a8d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:53.512842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f7e5-e2fc-4e6f-b9b1-06f6c06a8d71 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:53.513115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f7e5-e2fc-4e6f-b9b1-06f6c06a8d71 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:53.513412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f7e5-e2fc-4e6f-b9b1-06f6c06a8d71 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:53.514158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71f7e5-e2fc-4e6f-b9b1-06f6c06a8d71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:53.514459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71f7e5-e2fc-4e6f-b9b1-06f6c06a8d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:53.515839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71f7e5-e2fc-4e6f-b9b1-06f6c06a8d71 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:53.523757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 541/1095] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:53.530065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c3846-f493-47c8-b880-270ff0125653 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:53.627881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c3846-f493-47c8-b880-270ff0125653 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:53.658988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e51fa-2a84-4113-a2e0-17aa28b14cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:53.659850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e51fa-2a84-4113-a2e0-17aa28b14cda None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:53.660120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e51fa-2a84-4113-a2e0-17aa28b14cda None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:53.660373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e51fa-2a84-4113-a2e0-17aa28b14cda None admin] PATH_INFO: `/v3/users/2aa43868d0ae47919b2a0c2d637ede4f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:53.661611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e51fa-2a84-4113-a2e0-17aa28b14cda None admin] RBAC: Authorizing `identity:get_user(user_id=2aa43868d0ae47919b2a0c2d637ede4f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:53.663024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e51fa-2a84-4113-a2e0-17aa28b14cda None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:53.664619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 555/1096] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:44:53 2022] GET /identity/v3/users/2aa43868d0ae47919b2a0c2d637ede4f => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:53.671054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f7e5-e2fc-4e6f-b9b1-06f6c06a8d71 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:53.781698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f7e5-e2fc-4e6f-b9b1-06f6c06a8d71 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:53.818275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10feba-4eeb-43b0-82d7-79f967a27a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:53.819353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10feba-4eeb-43b0-82d7-79f967a27a9c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:53.819631 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10feba-4eeb-43b0-82d7-79f967a27a9c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:53.819904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10feba-4eeb-43b0-82d7-79f967a27a9c None admin] PATH_INFO: `/v3/projects/2367a0dfe644410ea8fb6fef52411d8d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:53.821134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10feba-4eeb-43b0-82d7-79f967a27a9c None admin] RBAC: Authorizing `identity:get_project(project_id=2367a0dfe644410ea8fb6fef52411d8d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:53.822777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10feba-4eeb-43b0-82d7-79f967a27a9c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:53.825573 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 542/1097] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:44:53 2022] GET /identity/v3/projects/2367a0dfe644410ea8fb6fef52411d8d => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:53.836730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e51fa-2a84-4113-a2e0-17aa28b14cda None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:53.938570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e51fa-2a84-4113-a2e0-17aa28b14cda None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:53.971062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4949af7-1051-487e-b254-728edf5c4323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:53.971934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4949af7-1051-487e-b254-728edf5c4323 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:53.972207 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4949af7-1051-487e-b254-728edf5c4323 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:53.972470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4949af7-1051-487e-b254-728edf5c4323 None admin] PATH_INFO: `/v3/projects/2367a0dfe644410ea8fb6fef52411d8d/users/2aa43868d0ae47919b2a0c2d637ede4f/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:53.974508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4949af7-1051-487e-b254-728edf5c4323 None admin] RBAC: Authorizing `identity:create_grant(project_id=2367a0dfe644410ea8fb6fef52411d8d, user_id=2aa43868d0ae47919b2a0c2d637ede4f, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:53.975919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4949af7-1051-487e-b254-728edf5c4323 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:53.991478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 556/1098] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:44:53 2022] PUT /identity/v3/projects/2367a0dfe644410ea8fb6fef52411d8d/users/2aa43868d0ae47919b2a0c2d637ede4f/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:44:56.155968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1aae5-2fa0-4864-9b08-049c8c76cece None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:56.156524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1aae5-2fa0-4864-9b08-049c8c76cece None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:56.156524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1aae5-2fa0-4864-9b08-049c8c76cece None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:56.157927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 543/1099] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:56.164247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546a961-6f4c-4019-ba73-af3e427b55ee None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:56.164962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546a961-6f4c-4019-ba73-af3e427b55ee None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:56.165107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546a961-6f4c-4019-ba73-af3e427b55ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:56.186350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-2546a961-6f4c-4019-ba73-af3e427b55ee None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:56.187541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-2546a961-6f4c-4019-ba73-af3e427b55ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:56.263336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 557/1100] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:56.288193 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1aae5-2fa0-4864-9b08-049c8c76cece None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:56.406413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1aae5-2fa0-4864-9b08-049c8c76cece None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:56.445103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ecc7e-dff9-460a-9bd9-938a1428266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:56.445926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ecc7e-dff9-460a-9bd9-938a1428266d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:56.446201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ecc7e-dff9-460a-9bd9-938a1428266d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:56.446470 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ecc7e-dff9-460a-9bd9-938a1428266d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:56.457078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ecc7e-dff9-460a-9bd9-938a1428266d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-586ecc7e-dff9-460a-9bd9-938a1428266d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:44:56.464601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:44:56.465630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:44:56.466814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 544/1101] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:44:56.472052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546a961-6f4c-4019-ba73-af3e427b55ee None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:56.588847 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546a961-6f4c-4019-ba73-af3e427b55ee None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:56.623663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b1f8a-ff52-45ec-bb57-34da1e2d8fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:56.624623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b1f8a-ff52-45ec-bb57-34da1e2d8fe8 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:56.624902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b1f8a-ff52-45ec-bb57-34da1e2d8fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:56.625163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b1f8a-ff52-45ec-bb57-34da1e2d8fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:56.625945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b1f8a-ff52-45ec-bb57-34da1e2d8fe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:56.626251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b1f8a-ff52-45ec-bb57-34da1e2d8fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:56.627667 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b1f8a-ff52-45ec-bb57-34da1e2d8fe8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:56.635633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 558/1102] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:56.644857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ecc7e-dff9-460a-9bd9-938a1428266d None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:56.749757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ecc7e-dff9-460a-9bd9-938a1428266d None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:56.791926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b189c6-c892-4e0c-9cc6-0a6ff167de25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:56.792784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b189c6-c892-4e0c-9cc6-0a6ff167de25 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:56.793059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b189c6-c892-4e0c-9cc6-0a6ff167de25 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:56.793349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b189c6-c892-4e0c-9cc6-0a6ff167de25 None admin] PATH_INFO: `/v3/users/2aa43868d0ae47919b2a0c2d637ede4f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:56.794587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b189c6-c892-4e0c-9cc6-0a6ff167de25 None admin] RBAC: Authorizing `identity:get_user(user_id=2aa43868d0ae47919b2a0c2d637ede4f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:56.796001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b189c6-c892-4e0c-9cc6-0a6ff167de25 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:56.797673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 545/1103] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:44:56 2022] GET /identity/v3/users/2aa43868d0ae47919b2a0c2d637ede4f => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:56.803672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b1f8a-ff52-45ec-bb57-34da1e2d8fe8 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:56.918179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b1f8a-ff52-45ec-bb57-34da1e2d8fe8 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:56.951917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f0d7e-e398-4b32-bc31-37c094ed6626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:56.952556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f0d7e-e398-4b32-bc31-37c094ed6626 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:56.952837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f0d7e-e398-4b32-bc31-37c094ed6626 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:56.953118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f0d7e-e398-4b32-bc31-37c094ed6626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:57.023011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f0d7e-e398-4b32-bc31-37c094ed6626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:57.024381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f0d7e-e398-4b32-bc31-37c094ed6626 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:57.126933 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 559/1104] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:44:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:44:57.133672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b189c6-c892-4e0c-9cc6-0a6ff167de25 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:57.236198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b189c6-c892-4e0c-9cc6-0a6ff167de25 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:57.269852 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a2fa2-5294-48c1-84de-dc6dc75291b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:57.270694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2fa2-5294-48c1-84de-dc6dc75291b8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:57.270969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2fa2-5294-48c1-84de-dc6dc75291b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:57.271238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2fa2-5294-48c1-84de-dc6dc75291b8 None admin] PATH_INFO: `/v3/projects/2367a0dfe644410ea8fb6fef52411d8d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:57.272401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a2fa2-5294-48c1-84de-dc6dc75291b8 None admin] RBAC: Authorizing `identity:get_project(project_id=2367a0dfe644410ea8fb6fef52411d8d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:57.273899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a2fa2-5294-48c1-84de-dc6dc75291b8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:57.275466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 546/1105] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:44:57 2022] GET /identity/v3/projects/2367a0dfe644410ea8fb6fef52411d8d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:57.281908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f0d7e-e398-4b32-bc31-37c094ed6626 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:57.399014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f0d7e-e398-4b32-bc31-37c094ed6626 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:57.433066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d19e2-2449-4067-9e5b-96a6ec2f1df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:57.433740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d19e2-2449-4067-9e5b-96a6ec2f1df3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:57.434026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d19e2-2449-4067-9e5b-96a6ec2f1df3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:57.434295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d19e2-2449-4067-9e5b-96a6ec2f1df3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:57.435141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d19e2-2449-4067-9e5b-96a6ec2f1df3 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=2367a0dfe644410ea8fb6fef52411d8d, user.id=2aa43868d0ae47919b2a0c2d637ede4f) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:44:57.435452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d19e2-2449-4067-9e5b-96a6ec2f1df3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:57.436890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d19e2-2449-4067-9e5b-96a6ec2f1df3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:57.443762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 560/1106] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:44:57 2022] GET /identity/v3/role_assignments?user.id=2aa43868d0ae47919b2a0c2d637ede4f&scope.project.id=2367a0dfe644410ea8fb6fef52411d8d&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:59.646976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3d51-6404-4144-bfea-75214de916d5 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:59.647585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3d51-6404-4144-bfea-75214de916d5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:59.647585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3d51-6404-4144-bfea-75214de916d5 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:59.648865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 547/1107] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:44:59.655122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cac01-97cf-438c-b1c5-2c814b522e61 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:59.655882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cac01-97cf-438c-b1c5-2c814b522e61 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:59.656019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cac01-97cf-438c-b1c5-2c814b522e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:59.683245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-ad2cac01-97cf-438c-b1c5-2c814b522e61 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:44:59.685062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ad2cac01-97cf-438c-b1c5-2c814b522e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:44:59.759233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 561/1108] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:44:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:44:59.786388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b3d51-6404-4144-bfea-75214de916d5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:44:59.891022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b3d51-6404-4144-bfea-75214de916d5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:44:59.925429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8210a-7f0a-4e66-84f9-aba3ceeb52fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:44:59.926211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8210a-7f0a-4e66-84f9-aba3ceeb52fc None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:44:59.926484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8210a-7f0a-4e66-84f9-aba3ceeb52fc None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:44:59.926752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8210a-7f0a-4e66-84f9-aba3ceeb52fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:44:59.928026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8210a-7f0a-4e66-84f9-aba3ceeb52fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:44:59.929466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8210a-7f0a-4e66-84f9-aba3ceeb52fc None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:44:59.931033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 548/1109] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:44:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:44:59.937547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cac01-97cf-438c-b1c5-2c814b522e61 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:00.044805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cac01-97cf-438c-b1c5-2c814b522e61 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:00.078272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b7089-df63-4974-b522-448cd288ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:00.078927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7089-df63-4974-b522-448cd288ac91 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:00.079243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7089-df63-4974-b522-448cd288ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:00.079572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7089-df63-4974-b522-448cd288ac91 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:00.080266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b7089-df63-4974-b522-448cd288ac91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:00.081718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b7089-df63-4974-b522-448cd288ac91 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:00.102827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 562/1110] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:44:59 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:45:02.355665 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c6673-6221-4977-853e-ec1accd99c8d None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:02.356543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c6673-6221-4977-853e-ec1accd99c8d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:02.356543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c6673-6221-4977-853e-ec1accd99c8d None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:02.358751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 549/1111] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:02.366710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444cbc0-95fd-4965-a0be-528372e4f8fc None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:02.367154 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444cbc0-95fd-4965-a0be-528372e4f8fc None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:02.367262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444cbc0-95fd-4965-a0be-528372e4f8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:02.386314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5444cbc0-95fd-4965-a0be-528372e4f8fc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:02.387469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5444cbc0-95fd-4965-a0be-528372e4f8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:02.452714 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 563/1112] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:45:02.476241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c6673-6221-4977-853e-ec1accd99c8d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:02.594810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c6673-6221-4977-853e-ec1accd99c8d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:02.629675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7e1f4-56c9-41b5-ad5b-92e6711ce8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:02.630451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7e1f4-56c9-41b5-ad5b-92e6711ce8c4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:02.630731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7e1f4-56c9-41b5-ad5b-92e6711ce8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:02.631000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7e1f4-56c9-41b5-ad5b-92e6711ce8c4 None admin] PATH_INFO: `/v3/roles/812e67b7a9204b8f925c8e613b2209de` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:02.632599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7e1f4-56c9-41b5-ad5b-92e6711ce8c4 None admin] RBAC: Authorizing `identity:get_role(role_id=812e67b7a9204b8f925c8e613b2209de)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:02.633996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7e1f4-56c9-41b5-ad5b-92e6711ce8c4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:02.635368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 550/1113] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:02 2022] GET /identity/v3/roles/812e67b7a9204b8f925c8e613b2209de => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:02.641682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444cbc0-95fd-4965-a0be-528372e4f8fc None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:02.740786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444cbc0-95fd-4965-a0be-528372e4f8fc None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:02.775287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f04b5-2084-40f5-922e-16cf2ec3556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:02.776138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f04b5-2084-40f5-922e-16cf2ec3556c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:02.776414 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f04b5-2084-40f5-922e-16cf2ec3556c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:02.776678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f04b5-2084-40f5-922e-16cf2ec3556c None admin] PATH_INFO: `/v3/users/f220e2246c9c4ba58fb768ebffa3120c` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:02.789657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f04b5-2084-40f5-922e-16cf2ec3556c None admin] RBAC: Authorizing `identity:get_user(user_id=f220e2246c9c4ba58fb768ebffa3120c)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:02.791081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f04b5-2084-40f5-922e-16cf2ec3556c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:02.792696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 564/1114] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:02 2022] GET /identity/v3/users/f220e2246c9c4ba58fb768ebffa3120c => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:02.799134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7e1f4-56c9-41b5-ad5b-92e6711ce8c4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:02.907030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7e1f4-56c9-41b5-ad5b-92e6711ce8c4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:02.940817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87790-3aed-4835-a0ce-ce45609a9de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:02.941492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87790-3aed-4835-a0ce-ce45609a9de6 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:02.941770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87790-3aed-4835-a0ce-ce45609a9de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:02.942045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87790-3aed-4835-a0ce-ce45609a9de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:03.017985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa87790-3aed-4835-a0ce-ce45609a9de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:03.019418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa87790-3aed-4835-a0ce-ce45609a9de6 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:03.115157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 551/1115] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:45:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:45:03.121429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f04b5-2084-40f5-922e-16cf2ec3556c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:03.216141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f04b5-2084-40f5-922e-16cf2ec3556c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:03.249435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53592dbb-1f6e-4922-b473-4265ba7e2941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:03.250277 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592dbb-1f6e-4922-b473-4265ba7e2941 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:03.250553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592dbb-1f6e-4922-b473-4265ba7e2941 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:03.250822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592dbb-1f6e-4922-b473-4265ba7e2941 None admin] PATH_INFO: `/v3/projects/2367a0dfe644410ea8fb6fef52411d8d` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:03.252188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53592dbb-1f6e-4922-b473-4265ba7e2941 None admin] RBAC: Authorizing `identity:get_project(project_id=2367a0dfe644410ea8fb6fef52411d8d)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:03.253613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53592dbb-1f6e-4922-b473-4265ba7e2941 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:03.255273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 565/1116] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:45:03 2022] GET /identity/v3/projects/2367a0dfe644410ea8fb6fef52411d8d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:03.261481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87790-3aed-4835-a0ce-ce45609a9de6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:03.369142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87790-3aed-4835-a0ce-ce45609a9de6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:03.407977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd96c04-fb4b-4b6b-a1c9-3cb2e9afd189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:03.408678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd96c04-fb4b-4b6b-a1c9-3cb2e9afd189 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:03.408967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd96c04-fb4b-4b6b-a1c9-3cb2e9afd189 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:03.409243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd96c04-fb4b-4b6b-a1c9-3cb2e9afd189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:03.410135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd96c04-fb4b-4b6b-a1c9-3cb2e9afd189 None admin] RBAC: Adding query filter params (role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=2367a0dfe644410ea8fb6fef52411d8d, user.id=f220e2246c9c4ba58fb768ebffa3120c) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:03.410473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd96c04-fb4b-4b6b-a1c9-3cb2e9afd189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:03.411947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd96c04-fb4b-4b6b-a1c9-3cb2e9afd189 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:03.417961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 552/1117] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:45:03 2022] GET /identity/v3/role_assignments?user.id=f220e2246c9c4ba58fb768ebffa3120c&scope.project.id=2367a0dfe644410ea8fb6fef52411d8d&role.id=812e67b7a9204b8f925c8e613b2209de => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:45:05.614157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45a3b6-a60b-4aab-812b-7725a3a695de None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:05.614739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45a3b6-a60b-4aab-812b-7725a3a695de None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:05.614739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45a3b6-a60b-4aab-812b-7725a3a695de None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:05.616791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 566/1118] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:05.626107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe17159-1a9d-4589-bc3a-1d6fc60a11d7 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:05.626501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe17159-1a9d-4589-bc3a-1d6fc60a11d7 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:05.626749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe17159-1a9d-4589-bc3a-1d6fc60a11d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:05.645064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-6fe17159-1a9d-4589-bc3a-1d6fc60a11d7 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:05.646264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6fe17159-1a9d-4589-bc3a-1d6fc60a11d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:05.714174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 553/1119] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:05.736795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45a3b6-a60b-4aab-812b-7725a3a695de None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:05.839753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45a3b6-a60b-4aab-812b-7725a3a695de None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:05.874462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29457-0a19-4954-8c85-e105904a5df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:05.875301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29457-0a19-4954-8c85-e105904a5df1 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:05.875584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29457-0a19-4954-8c85-e105904a5df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:05.875855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29457-0a19-4954-8c85-e105904a5df1 None admin] PATH_INFO: `/v3/roles/812e67b7a9204b8f925c8e613b2209de` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:05.877492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29457-0a19-4954-8c85-e105904a5df1 None admin] RBAC: Authorizing `identity:get_role(role_id=812e67b7a9204b8f925c8e613b2209de)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:05.878873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29457-0a19-4954-8c85-e105904a5df1 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:05.880235 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 567/1120] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:05 2022] GET /identity/v3/roles/812e67b7a9204b8f925c8e613b2209de => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:05.886975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe17159-1a9d-4589-bc3a-1d6fc60a11d7 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:05.992856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe17159-1a9d-4589-bc3a-1d6fc60a11d7 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:06.036888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642087d1-1af6-475d-89a5-1533a14e0ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:06.037784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642087d1-1af6-475d-89a5-1533a14e0ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:06.038067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642087d1-1af6-475d-89a5-1533a14e0ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:06.038343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642087d1-1af6-475d-89a5-1533a14e0ad2 None admin] PATH_INFO: `/v3/users/f220e2246c9c4ba58fb768ebffa3120c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:06.039594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642087d1-1af6-475d-89a5-1533a14e0ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=f220e2246c9c4ba58fb768ebffa3120c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:06.041112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642087d1-1af6-475d-89a5-1533a14e0ad2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:06.042745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 554/1121] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:05 2022] GET /identity/v3/users/f220e2246c9c4ba58fb768ebffa3120c => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:06.048746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29457-0a19-4954-8c85-e105904a5df1 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:06.158872 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29457-0a19-4954-8c85-e105904a5df1 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:06.194276 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e981a-a653-4d52-8644-e4a4fef364ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:06.195110 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e981a-a653-4d52-8644-e4a4fef364ef None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:06.195393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e981a-a653-4d52-8644-e4a4fef364ef None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:06.195665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e981a-a653-4d52-8644-e4a4fef364ef None admin] PATH_INFO: `/v3/projects/2367a0dfe644410ea8fb6fef52411d8d` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:06.196950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e981a-a653-4d52-8644-e4a4fef364ef None admin] RBAC: Authorizing `identity:get_project(project_id=2367a0dfe644410ea8fb6fef52411d8d)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:06.198438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e981a-a653-4d52-8644-e4a4fef364ef None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:06.200101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 568/1122] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:45:06 2022] GET /identity/v3/projects/2367a0dfe644410ea8fb6fef52411d8d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:06.208427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642087d1-1af6-475d-89a5-1533a14e0ad2 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:06.309816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642087d1-1af6-475d-89a5-1533a14e0ad2 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:06.342943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29306ff2-4b3b-414f-bb74-614e60f1f5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:06.343810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29306ff2-4b3b-414f-bb74-614e60f1f5c7 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:06.344083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29306ff2-4b3b-414f-bb74-614e60f1f5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:06.344351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29306ff2-4b3b-414f-bb74-614e60f1f5c7 None admin] PATH_INFO: `/v3/projects/2367a0dfe644410ea8fb6fef52411d8d/users/f220e2246c9c4ba58fb768ebffa3120c/roles/812e67b7a9204b8f925c8e613b2209de` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:06.346707 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29306ff2-4b3b-414f-bb74-614e60f1f5c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2367a0dfe644410ea8fb6fef52411d8d, user_id=f220e2246c9c4ba58fb768ebffa3120c, role_id=812e67b7a9204b8f925c8e613b2209de)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:06.348108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29306ff2-4b3b-414f-bb74-614e60f1f5c7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:06.363466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 555/1123] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:45:06 2022] PUT /identity/v3/projects/2367a0dfe644410ea8fb6fef52411d8d/users/f220e2246c9c4ba58fb768ebffa3120c/roles/812e67b7a9204b8f925c8e613b2209de => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:45:08.551797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ce64-d598-43e9-8a85-08959533e1de None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:08.552611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ce64-d598-43e9-8a85-08959533e1de None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:08.552611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ce64-d598-43e9-8a85-08959533e1de None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:08.554891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 569/1124] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:08.561188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6edc2e-aaf2-4ede-97c7-be3c4b4e546a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:08.561662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6edc2e-aaf2-4ede-97c7-be3c4b4e546a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:08.561786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6edc2e-aaf2-4ede-97c7-be3c4b4e546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:08.579725 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ce6edc2e-aaf2-4ede-97c7-be3c4b4e546a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:08.580910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ce6edc2e-aaf2-4ede-97c7-be3c4b4e546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:08.647622 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 556/1125] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:08.672455 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ce64-d598-43e9-8a85-08959533e1de None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:08.786310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ce64-d598-43e9-8a85-08959533e1de None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:08.821012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789ff24-ae8d-48eb-8553-6b07b5f2e9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:08.821959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789ff24-ae8d-48eb-8553-6b07b5f2e9be None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:08.822230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789ff24-ae8d-48eb-8553-6b07b5f2e9be None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:08.822507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789ff24-ae8d-48eb-8553-6b07b5f2e9be None admin] PATH_INFO: `/v3/roles/812e67b7a9204b8f925c8e613b2209de` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:08.824224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789ff24-ae8d-48eb-8553-6b07b5f2e9be None admin] RBAC: Authorizing `identity:get_role(role_id=812e67b7a9204b8f925c8e613b2209de)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:08.825632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789ff24-ae8d-48eb-8553-6b07b5f2e9be None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:08.827000 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 570/1126] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:08 2022] GET /identity/v3/roles/812e67b7a9204b8f925c8e613b2209de => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:08.835734 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6edc2e-aaf2-4ede-97c7-be3c4b4e546a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:08.931809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6edc2e-aaf2-4ede-97c7-be3c4b4e546a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:08.964604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5002-4660-4668-bbfc-0aef5eb0f43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:08.965478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5002-4660-4668-bbfc-0aef5eb0f43f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:08.965755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5002-4660-4668-bbfc-0aef5eb0f43f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:08.966010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5002-4660-4668-bbfc-0aef5eb0f43f None admin] PATH_INFO: `/v3/users/f220e2246c9c4ba58fb768ebffa3120c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:08.967195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5002-4660-4668-bbfc-0aef5eb0f43f None admin] RBAC: Authorizing `identity:get_user(user_id=f220e2246c9c4ba58fb768ebffa3120c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:08.968612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5002-4660-4668-bbfc-0aef5eb0f43f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:08.970233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 557/1127] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:08 2022] GET /identity/v3/users/f220e2246c9c4ba58fb768ebffa3120c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:08.976855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789ff24-ae8d-48eb-8553-6b07b5f2e9be None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:09.082231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789ff24-ae8d-48eb-8553-6b07b5f2e9be None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:09.114962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2eada-209c-4d40-bb9f-a9d60cbc27d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:09.115659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2eada-209c-4d40-bb9f-a9d60cbc27d0 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:09.115934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2eada-209c-4d40-bb9f-a9d60cbc27d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:09.116200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2eada-209c-4d40-bb9f-a9d60cbc27d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:09.180369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2eada-209c-4d40-bb9f-a9d60cbc27d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:09.181816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2eada-209c-4d40-bb9f-a9d60cbc27d0 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:09.275464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 571/1128] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:45:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:45:09.284183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5002-4660-4668-bbfc-0aef5eb0f43f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:09.399417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5002-4660-4668-bbfc-0aef5eb0f43f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:09.433751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cbc2a-076f-40b0-8b4a-588342a0b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:09.434602 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cbc2a-076f-40b0-8b4a-588342a0b792 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:09.434877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cbc2a-076f-40b0-8b4a-588342a0b792 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:09.435146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cbc2a-076f-40b0-8b4a-588342a0b792 None admin] PATH_INFO: `/v3/projects/2367a0dfe644410ea8fb6fef52411d8d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:09.436413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cbc2a-076f-40b0-8b4a-588342a0b792 None admin] RBAC: Authorizing `identity:get_project(project_id=2367a0dfe644410ea8fb6fef52411d8d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:09.437862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cbc2a-076f-40b0-8b4a-588342a0b792 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:09.439586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 558/1129] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:45:09 2022] GET /identity/v3/projects/2367a0dfe644410ea8fb6fef52411d8d => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:09.445867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2eada-209c-4d40-bb9f-a9d60cbc27d0 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:09.553157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2eada-209c-4d40-bb9f-a9d60cbc27d0 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:09.588103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4ed8a-555e-4649-9304-f2e90f20faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:09.588751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4ed8a-555e-4649-9304-f2e90f20faf6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:09.589068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4ed8a-555e-4649-9304-f2e90f20faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:09.589393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4ed8a-555e-4649-9304-f2e90f20faf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:09.590282 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4ed8a-555e-4649-9304-f2e90f20faf6 None admin] RBAC: Adding query filter params (role.id=812e67b7a9204b8f925c8e613b2209de, scope.project.id=2367a0dfe644410ea8fb6fef52411d8d, user.id=f220e2246c9c4ba58fb768ebffa3120c) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:09.590617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4ed8a-555e-4649-9304-f2e90f20faf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:09.592070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4ed8a-555e-4649-9304-f2e90f20faf6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:09.598227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 572/1130] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:45:09 2022] GET /identity/v3/role_assignments?user.id=f220e2246c9c4ba58fb768ebffa3120c&scope.project.id=2367a0dfe644410ea8fb6fef52411d8d&role.id=812e67b7a9204b8f925c8e613b2209de => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:11.828571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caedcb0-f5ce-482d-a213-c12fcf6add7e None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:11.829492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caedcb0-f5ce-482d-a213-c12fcf6add7e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:11.829492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caedcb0-f5ce-482d-a213-c12fcf6add7e None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:11.831735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 559/1131] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:11.840354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7836f66-a82e-4cd9-a3ed-4f15147eba31 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:11.840785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7836f66-a82e-4cd9-a3ed-4f15147eba31 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:11.840925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7836f66-a82e-4cd9-a3ed-4f15147eba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:11.859930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d7836f66-a82e-4cd9-a3ed-4f15147eba31 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:11.861658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d7836f66-a82e-4cd9-a3ed-4f15147eba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:11.942881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 573/1132] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:11.966625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caedcb0-f5ce-482d-a213-c12fcf6add7e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:12.069408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caedcb0-f5ce-482d-a213-c12fcf6add7e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:12.103834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2de1f9-687d-4163-a38c-ac15a581317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:12.104608 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2de1f9-687d-4163-a38c-ac15a581317b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:12.104889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2de1f9-687d-4163-a38c-ac15a581317b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:12.105204 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2de1f9-687d-4163-a38c-ac15a581317b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:12.106572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2de1f9-687d-4163-a38c-ac15a581317b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:12.108045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2de1f9-687d-4163-a38c-ac15a581317b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:12.109820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 560/1133] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:12.116051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7836f66-a82e-4cd9-a3ed-4f15147eba31 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:12.223027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7836f66-a82e-4cd9-a3ed-4f15147eba31 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:12.257015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c4a1-7c9a-4ed5-8c84-8520dfec71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:12.257693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c4a1-7c9a-4ed5-8c84-8520dfec71c6 None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:12.257974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c4a1-7c9a-4ed5-8c84-8520dfec71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:12.258244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c4a1-7c9a-4ed5-8c84-8520dfec71c6 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:12.258934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88c4a1-7c9a-4ed5-8c84-8520dfec71c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:12.260353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88c4a1-7c9a-4ed5-8c84-8520dfec71c6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:12.287027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 574/1134] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:45:12 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:45:14.529517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74791e7d-6445-4e02-baef-76398b892ce4 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:14.530299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74791e7d-6445-4e02-baef-76398b892ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:14.530456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74791e7d-6445-4e02-baef-76398b892ce4 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:14.532597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 561/1135] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:14.537957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0880d-656a-467e-940e-0f34f63cb849 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:14.538391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0880d-656a-467e-940e-0f34f63cb849 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:14.538494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0880d-656a-467e-940e-0f34f63cb849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:14.556417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b3d0880d-656a-467e-940e-0f34f63cb849 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:14.557628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b3d0880d-656a-467e-940e-0f34f63cb849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:14.625678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 575/1136] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:14.650149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74791e7d-6445-4e02-baef-76398b892ce4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:14.750850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74791e7d-6445-4e02-baef-76398b892ce4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:14.784697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfcb7c-439f-4e17-b96c-a8f310ea87bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:14.785507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfcb7c-439f-4e17-b96c-a8f310ea87bc None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:14.785784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfcb7c-439f-4e17-b96c-a8f310ea87bc None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:14.786038 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfcb7c-439f-4e17-b96c-a8f310ea87bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:14.787256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfcb7c-439f-4e17-b96c-a8f310ea87bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:14.788677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfcb7c-439f-4e17-b96c-a8f310ea87bc None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:14.790295 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 562/1137] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:45:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:14.796472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0880d-656a-467e-940e-0f34f63cb849 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:14.893546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0880d-656a-467e-940e-0f34f63cb849 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:14.927251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01695c1-5688-4206-a2f9-c32297337a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:14.928121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01695c1-5688-4206-a2f9-c32297337a2e None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:14.928578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01695c1-5688-4206-a2f9-c32297337a2e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:14.929025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01695c1-5688-4206-a2f9-c32297337a2e None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:14.930038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01695c1-5688-4206-a2f9-c32297337a2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:14.932016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01695c1-5688-4206-a2f9-c32297337a2e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:14.955477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 576/1138] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:45:14 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:45:17.199385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03f6c4-31d0-4043-a072-8eb7371ba647 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:17.200275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03f6c4-31d0-4043-a072-8eb7371ba647 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:17.200275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03f6c4-31d0-4043-a072-8eb7371ba647 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:17.202585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 563/1139] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:17.208034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ebf8-6f3b-4682-bccd-2df3a76e442f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:17.208548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ebf8-6f3b-4682-bccd-2df3a76e442f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:17.208548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ebf8-6f3b-4682-bccd-2df3a76e442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:17.226840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-28c2ebf8-6f3b-4682-bccd-2df3a76e442f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:17.227994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-28c2ebf8-6f3b-4682-bccd-2df3a76e442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:17.296586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 577/1140] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:17.319895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03f6c4-31d0-4043-a072-8eb7371ba647 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:17.431800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03f6c4-31d0-4043-a072-8eb7371ba647 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:17.466922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff59ff9-4c24-44f0-baa7-c36ac63da98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:17.467710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff59ff9-4c24-44f0-baa7-c36ac63da98c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:17.468000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff59ff9-4c24-44f0-baa7-c36ac63da98c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:17.468269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff59ff9-4c24-44f0-baa7-c36ac63da98c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:17.478637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff59ff9-4c24-44f0-baa7-c36ac63da98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-2ff59ff9-4c24-44f0-baa7-c36ac63da98c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:45:17.486157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:45:17.487266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:45:17.488214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 564/1141] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:45:17.495924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ebf8-6f3b-4682-bccd-2df3a76e442f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:17.596881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ebf8-6f3b-4682-bccd-2df3a76e442f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:17.630215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514f7d2-212c-4d05-bfda-c73b545bcd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:17.630859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514f7d2-212c-4d05-bfda-c73b545bcd66 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:17.631138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514f7d2-212c-4d05-bfda-c73b545bcd66 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:17.631412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514f7d2-212c-4d05-bfda-c73b545bcd66 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:17.632154 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514f7d2-212c-4d05-bfda-c73b545bcd66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:17.632459 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514f7d2-212c-4d05-bfda-c73b545bcd66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:17.633853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514f7d2-212c-4d05-bfda-c73b545bcd66 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:17.641996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 578/1142] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:17.647903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff59ff9-4c24-44f0-baa7-c36ac63da98c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:17.750283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff59ff9-4c24-44f0-baa7-c36ac63da98c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:17.785126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780eea3-b644-447d-ad29-2d2d86ef83b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:17.786025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780eea3-b644-447d-ad29-2d2d86ef83b4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:17.786305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780eea3-b644-447d-ad29-2d2d86ef83b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:17.786574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780eea3-b644-447d-ad29-2d2d86ef83b4 None admin] PATH_INFO: `/v3/users/a13fce7038fb4f4d92ac25bda67261ad` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:17.799476 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780eea3-b644-447d-ad29-2d2d86ef83b4 None admin] RBAC: Authorizing `identity:get_user(user_id=a13fce7038fb4f4d92ac25bda67261ad)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:17.800930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780eea3-b644-447d-ad29-2d2d86ef83b4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:17.802567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 565/1143] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:17 2022] GET /identity/v3/users/a13fce7038fb4f4d92ac25bda67261ad => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:17.808767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514f7d2-212c-4d05-bfda-c73b545bcd66 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:17.905850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514f7d2-212c-4d05-bfda-c73b545bcd66 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:17.941073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bcbb8-3114-4d23-8c48-489e24c7346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:17.941737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bcbb8-3114-4d23-8c48-489e24c7346c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:17.942016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bcbb8-3114-4d23-8c48-489e24c7346c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:17.942285 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bcbb8-3114-4d23-8c48-489e24c7346c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:18.007689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bcbb8-3114-4d23-8c48-489e24c7346c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:18.009054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bcbb8-3114-4d23-8c48-489e24c7346c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:18.112443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 579/1144] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:45:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:45:18.120101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780eea3-b644-447d-ad29-2d2d86ef83b4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:18.238396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780eea3-b644-447d-ad29-2d2d86ef83b4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:18.275040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584895d-4189-4083-bd80-5d161f35392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:18.275825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584895d-4189-4083-bd80-5d161f35392d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:18.276104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584895d-4189-4083-bd80-5d161f35392d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:18.276372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584895d-4189-4083-bd80-5d161f35392d None admin] PATH_INFO: `/v3/projects/112f398b4f53430798313171a0b51809` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:18.277696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584895d-4189-4083-bd80-5d161f35392d None admin] RBAC: Authorizing `identity:get_project(project_id=112f398b4f53430798313171a0b51809)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:18.279154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584895d-4189-4083-bd80-5d161f35392d None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:18.280821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 566/1145] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:45:18 2022] GET /identity/v3/projects/112f398b4f53430798313171a0b51809 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:18.287203 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bcbb8-3114-4d23-8c48-489e24c7346c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:18.391134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bcbb8-3114-4d23-8c48-489e24c7346c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:18.424005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6987be-1f26-4a4b-8034-b6b92c605cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:18.424638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6987be-1f26-4a4b-8034-b6b92c605cf4 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:18.424892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6987be-1f26-4a4b-8034-b6b92c605cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:18.425161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6987be-1f26-4a4b-8034-b6b92c605cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:18.426020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6987be-1f26-4a4b-8034-b6b92c605cf4 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=112f398b4f53430798313171a0b51809, user.id=a13fce7038fb4f4d92ac25bda67261ad) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:18.426325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6987be-1f26-4a4b-8034-b6b92c605cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:18.427734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6987be-1f26-4a4b-8034-b6b92c605cf4 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:18.433052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 580/1146] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:45:18 2022] GET /identity/v3/role_assignments?user.id=a13fce7038fb4f4d92ac25bda67261ad&scope.project.id=112f398b4f53430798313171a0b51809&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:20.622140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113d949-917a-486f-a260-4b238125d2d4 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:20.623009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113d949-917a-486f-a260-4b238125d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:20.623009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113d949-917a-486f-a260-4b238125d2d4 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:20.625548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 567/1147] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:20.631163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9008e04-4f46-4cb4-a7b5-9e4472de1701 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:20.631593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9008e04-4f46-4cb4-a7b5-9e4472de1701 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:20.631684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9008e04-4f46-4cb4-a7b5-9e4472de1701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:20.649607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c9008e04-4f46-4cb4-a7b5-9e4472de1701 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:20.650756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c9008e04-4f46-4cb4-a7b5-9e4472de1701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:20.715515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 581/1148] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 18:45:20.738865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113d949-917a-486f-a260-4b238125d2d4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:20.848438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113d949-917a-486f-a260-4b238125d2d4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:20.882136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a87c-12c5-4e98-83e7-05e581478f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:20.882916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a87c-12c5-4e98-83e7-05e581478f83 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:20.883168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a87c-12c5-4e98-83e7-05e581478f83 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:20.883454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a87c-12c5-4e98-83e7-05e581478f83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:20.893670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127a87c-12c5-4e98-83e7-05e581478f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8127a87c-12c5-4e98-83e7-05e581478f83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:45:20.901134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:45:20.902155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:45:20.903064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 568/1149] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:45:20.908847 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9008e04-4f46-4cb4-a7b5-9e4472de1701 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:21.005369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9008e04-4f46-4cb4-a7b5-9e4472de1701 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:21.038711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1715942-ee13-497f-a5ca-d403b586db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:21.039491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1715942-ee13-497f-a5ca-d403b586db98 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:21.039984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1715942-ee13-497f-a5ca-d403b586db98 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:21.040468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1715942-ee13-497f-a5ca-d403b586db98 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:21.041563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1715942-ee13-497f-a5ca-d403b586db98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:21.041866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1715942-ee13-497f-a5ca-d403b586db98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:21.043647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1715942-ee13-497f-a5ca-d403b586db98 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:21.054802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 582/1150] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:21.061150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a87c-12c5-4e98-83e7-05e581478f83 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:21.163680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a87c-12c5-4e98-83e7-05e581478f83 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:21.196624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1057d5-b616-47bf-8e5a-9a9dfaf04086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:21.197551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1057d5-b616-47bf-8e5a-9a9dfaf04086 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:21.197832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1057d5-b616-47bf-8e5a-9a9dfaf04086 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:21.198102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1057d5-b616-47bf-8e5a-9a9dfaf04086 None admin] PATH_INFO: `/v3/users/a13fce7038fb4f4d92ac25bda67261ad` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:21.199349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1057d5-b616-47bf-8e5a-9a9dfaf04086 None admin] RBAC: Authorizing `identity:get_user(user_id=a13fce7038fb4f4d92ac25bda67261ad)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:21.200834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1057d5-b616-47bf-8e5a-9a9dfaf04086 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:21.202500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 569/1151] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:21 2022] GET /identity/v3/users/a13fce7038fb4f4d92ac25bda67261ad => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:21.208574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1715942-ee13-497f-a5ca-d403b586db98 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:21.321248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1715942-ee13-497f-a5ca-d403b586db98 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:21.364982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfa593-c1b8-4812-b39d-76d31821d38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:21.365859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfa593-c1b8-4812-b39d-76d31821d38f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:21.366139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfa593-c1b8-4812-b39d-76d31821d38f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:21.366413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfa593-c1b8-4812-b39d-76d31821d38f None admin] PATH_INFO: `/v3/projects/112f398b4f53430798313171a0b51809` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:21.367636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfa593-c1b8-4812-b39d-76d31821d38f None admin] RBAC: Authorizing `identity:get_project(project_id=112f398b4f53430798313171a0b51809)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:21.369075 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfa593-c1b8-4812-b39d-76d31821d38f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:21.370787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 583/1152] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:45:21 2022] GET /identity/v3/projects/112f398b4f53430798313171a0b51809 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:21.377274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1057d5-b616-47bf-8e5a-9a9dfaf04086 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:21.477316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1057d5-b616-47bf-8e5a-9a9dfaf04086 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:21.510655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200896d9-5119-4cb5-9661-bf28a09e9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:21.511536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200896d9-5119-4cb5-9661-bf28a09e9404 None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:21.511812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200896d9-5119-4cb5-9661-bf28a09e9404 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:21.512058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200896d9-5119-4cb5-9661-bf28a09e9404 None admin] PATH_INFO: `/v3/projects/112f398b4f53430798313171a0b51809/users/a13fce7038fb4f4d92ac25bda67261ad/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:21.514114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200896d9-5119-4cb5-9661-bf28a09e9404 None admin] RBAC: Authorizing `identity:create_grant(project_id=112f398b4f53430798313171a0b51809, user_id=a13fce7038fb4f4d92ac25bda67261ad, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:21.515528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200896d9-5119-4cb5-9661-bf28a09e9404 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:21.535082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 570/1153] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:45:21 2022] PUT /identity/v3/projects/112f398b4f53430798313171a0b51809/users/a13fce7038fb4f4d92ac25bda67261ad/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:45:23.768184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb32dd5-21f1-461a-97f6-d8f46bde91db None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:23.769024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb32dd5-21f1-461a-97f6-d8f46bde91db None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:23.769024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb32dd5-21f1-461a-97f6-d8f46bde91db None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:23.771209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 584/1154] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:23.777366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd54a7c-d6be-4e71-b643-45362962cd21 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:23.777831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd54a7c-d6be-4e71-b643-45362962cd21 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:23.777995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd54a7c-d6be-4e71-b643-45362962cd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:23.796967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-2dd54a7c-d6be-4e71-b643-45362962cd21 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:23.798245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2dd54a7c-d6be-4e71-b643-45362962cd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:23.868442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 571/1155] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:23.901592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb32dd5-21f1-461a-97f6-d8f46bde91db None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:24.002822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb32dd5-21f1-461a-97f6-d8f46bde91db None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:24.035610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab59f-557f-44cd-b97e-9dab56f3df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:24.036392 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab59f-557f-44cd-b97e-9dab56f3df70 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:24.036667 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab59f-557f-44cd-b97e-9dab56f3df70 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:24.036934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab59f-557f-44cd-b97e-9dab56f3df70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:24.047800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab59f-557f-44cd-b97e-9dab56f3df70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-6f7ab59f-557f-44cd-b97e-9dab56f3df70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:45:24.055265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:45:24.056310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:24.057304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:45:24.061321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 585/1156] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:45:24.062392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd54a7c-d6be-4e71-b643-45362962cd21 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:24.159282 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd54a7c-d6be-4e71-b643-45362962cd21 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:24.192419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec917-c5dc-4711-b042-3aaef6ac6df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:24.193065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec917-c5dc-4711-b042-3aaef6ac6df1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:24.193340 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec917-c5dc-4711-b042-3aaef6ac6df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:24.193641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec917-c5dc-4711-b042-3aaef6ac6df1 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:24.194381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fec917-c5dc-4711-b042-3aaef6ac6df1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:24.194680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fec917-c5dc-4711-b042-3aaef6ac6df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:24.196021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fec917-c5dc-4711-b042-3aaef6ac6df1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:24.204046 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 572/1157] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:45:24.210299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab59f-557f-44cd-b97e-9dab56f3df70 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:24.312583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab59f-557f-44cd-b97e-9dab56f3df70 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:24.349610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf003d-fedb-4dd3-bb4a-3bf9b030827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:24.350457 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf003d-fedb-4dd3-bb4a-3bf9b030827b None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:24.350731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf003d-fedb-4dd3-bb4a-3bf9b030827b None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:24.350997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf003d-fedb-4dd3-bb4a-3bf9b030827b None admin] PATH_INFO: `/v3/users/a13fce7038fb4f4d92ac25bda67261ad` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:24.352206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf003d-fedb-4dd3-bb4a-3bf9b030827b None admin] RBAC: Authorizing `identity:get_user(user_id=a13fce7038fb4f4d92ac25bda67261ad)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:24.353651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf003d-fedb-4dd3-bb4a-3bf9b030827b None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:24.355230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 586/1158] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:24 2022] GET /identity/v3/users/a13fce7038fb4f4d92ac25bda67261ad => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:24.364471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec917-c5dc-4711-b042-3aaef6ac6df1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:24.469455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec917-c5dc-4711-b042-3aaef6ac6df1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:24.503442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395fa56-4450-4966-b252-2ac7730873e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:24.504084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395fa56-4450-4966-b252-2ac7730873e7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:24.504357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395fa56-4450-4966-b252-2ac7730873e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:24.504632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395fa56-4450-4966-b252-2ac7730873e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:24.569985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395fa56-4450-4966-b252-2ac7730873e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:24.571352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395fa56-4450-4966-b252-2ac7730873e7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:24.666239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 573/1159] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:45:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:45:24.673206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf003d-fedb-4dd3-bb4a-3bf9b030827b None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:24.781419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf003d-fedb-4dd3-bb4a-3bf9b030827b None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:24.814527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e15e5-d78e-477b-8c89-2db25d4acc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:24.815363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e15e5-d78e-477b-8c89-2db25d4acc9c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:24.815632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e15e5-d78e-477b-8c89-2db25d4acc9c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:24.815899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e15e5-d78e-477b-8c89-2db25d4acc9c None admin] PATH_INFO: `/v3/projects/112f398b4f53430798313171a0b51809` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:24.817877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e15e5-d78e-477b-8c89-2db25d4acc9c None admin] RBAC: Authorizing `identity:get_project(project_id=112f398b4f53430798313171a0b51809)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:24.819523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e15e5-d78e-477b-8c89-2db25d4acc9c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:24.821964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 587/1160] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:45:24 2022] GET /identity/v3/projects/112f398b4f53430798313171a0b51809 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:24.830766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395fa56-4450-4966-b252-2ac7730873e7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:24.943417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395fa56-4450-4966-b252-2ac7730873e7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:24.976670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32f665-b0c2-4b88-bf0b-c9619bc08b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:24.977329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f665-b0c2-4b88-bf0b-c9619bc08b84 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:24.977613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f665-b0c2-4b88-bf0b-c9619bc08b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:24.977887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f665-b0c2-4b88-bf0b-c9619bc08b84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:24.978711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f665-b0c2-4b88-bf0b-c9619bc08b84 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=112f398b4f53430798313171a0b51809, user.id=a13fce7038fb4f4d92ac25bda67261ad) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:24.979021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f665-b0c2-4b88-bf0b-c9619bc08b84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:24.980433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f665-b0c2-4b88-bf0b-c9619bc08b84 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:24.986351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 574/1161] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:45:24 2022] GET /identity/v3/role_assignments?user.id=a13fce7038fb4f4d92ac25bda67261ad&scope.project.id=112f398b4f53430798313171a0b51809&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:27.228454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efbddd-c4cf-4b03-b34d-22dee09b10b2 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:27.229341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efbddd-c4cf-4b03-b34d-22dee09b10b2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:27.229341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efbddd-c4cf-4b03-b34d-22dee09b10b2 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:27.231533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 588/1162] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:27.237927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2628a1-94c2-4765-ab0f-4afa00cdd981 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:27.238636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2628a1-94c2-4765-ab0f-4afa00cdd981 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:27.238800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2628a1-94c2-4765-ab0f-4afa00cdd981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:27.261176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-fd2628a1-94c2-4765-ab0f-4afa00cdd981 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:27.262381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-fd2628a1-94c2-4765-ab0f-4afa00cdd981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:27.337217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 575/1163] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:27.360090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efbddd-c4cf-4b03-b34d-22dee09b10b2 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:27.486975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efbddd-c4cf-4b03-b34d-22dee09b10b2 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:27.529474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82189e-1af1-48f5-a23d-d37f94cb4431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:27.530417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82189e-1af1-48f5-a23d-d37f94cb4431 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:27.530807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82189e-1af1-48f5-a23d-d37f94cb4431 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:27.531200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82189e-1af1-48f5-a23d-d37f94cb4431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:27.599073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82189e-1af1-48f5-a23d-d37f94cb4431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:27.600514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82189e-1af1-48f5-a23d-d37f94cb4431 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:27.708519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 589/1164] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:45:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:45:27.714840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2628a1-94c2-4765-ab0f-4afa00cdd981 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:27.818771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2628a1-94c2-4765-ab0f-4afa00cdd981 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:27.853429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3cfc5-69f7-48f6-992a-4cdbc21b9872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:27.854224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3cfc5-69f7-48f6-992a-4cdbc21b9872 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:27.854504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3cfc5-69f7-48f6-992a-4cdbc21b9872 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:27.854786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3cfc5-69f7-48f6-992a-4cdbc21b9872 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:27.861739 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3cfc5-69f7-48f6-992a-4cdbc21b9872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:27.863170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3cfc5-69f7-48f6-992a-4cdbc21b9872 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8ee3cfc5-69f7-48f6-992a-4cdbc21b9872 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:45:27.878057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:45:27.879216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:45:27.880555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 576/1165] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:45:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:45:27.887536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82189e-1af1-48f5-a23d-d37f94cb4431 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:27.996626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82189e-1af1-48f5-a23d-d37f94cb4431 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:28.031807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bada59-f3a7-41e5-aabd-5b33010bbc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:28.032461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bada59-f3a7-41e5-aabd-5b33010bbc97 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:28.032740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bada59-f3a7-41e5-aabd-5b33010bbc97 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:28.033015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bada59-f3a7-41e5-aabd-5b33010bbc97 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:28.033781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bada59-f3a7-41e5-aabd-5b33010bbc97 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:28.034088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bada59-f3a7-41e5-aabd-5b33010bbc97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:28.035454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bada59-f3a7-41e5-aabd-5b33010bbc97 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:28.042729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 590/1166] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 4 18:45:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:30.218161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f86dd-382f-4bb2-a82d-e3f31f33a558 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:30.218824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f86dd-382f-4bb2-a82d-e3f31f33a558 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:30.218824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f86dd-382f-4bb2-a82d-e3f31f33a558 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:30.220113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 577/1167] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:30.226419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1ec4-12f6-433f-a3ca-f19e57bfeb05 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:30.227168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1ec4-12f6-433f-a3ca-f19e57bfeb05 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:30.227298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1ec4-12f6-433f-a3ca-f19e57bfeb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:30.253257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3fcc1ec4-12f6-433f-a3ca-f19e57bfeb05 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:30.254464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3fcc1ec4-12f6-433f-a3ca-f19e57bfeb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:30.327279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 591/1168] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:30.356731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f86dd-382f-4bb2-a82d-e3f31f33a558 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:30.459543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f86dd-382f-4bb2-a82d-e3f31f33a558 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:30.498979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dda5db-0954-4d3d-8504-ba2c25e93e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:30.499550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda5db-0954-4d3d-8504-ba2c25e93e00 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:30.499857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda5db-0954-4d3d-8504-ba2c25e93e00 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:30.500149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda5db-0954-4d3d-8504-ba2c25e93e00 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:30.500918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda5db-0954-4d3d-8504-ba2c25e93e00 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:30.502313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda5db-0954-4d3d-8504-ba2c25e93e00 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:30.520300 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 578/1169] 10.222.0.35 () {60 vars in 1138 bytes} [Wed May 4 18:45:30 2022] POST /identity/v3/domains => generated 267 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:45:32.776473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ba6f9-2c31-4f90-8dbe-7703ed698546 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:32.777345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ba6f9-2c31-4f90-8dbe-7703ed698546 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:32.777345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ba6f9-2c31-4f90-8dbe-7703ed698546 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:32.779506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 592/1170] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:45:32.785950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f409-e20f-4799-8b82-ba2117d44c56 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:32.786667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f409-e20f-4799-8b82-ba2117d44c56 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:32.786766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f409-e20f-4799-8b82-ba2117d44c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:32.815008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-00b4f409-e20f-4799-8b82-ba2117d44c56 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:32.816319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-00b4f409-e20f-4799-8b82-ba2117d44c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:32.887079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 579/1171] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:32.924416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ba6f9-2c31-4f90-8dbe-7703ed698546 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:33.040329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ba6f9-2c31-4f90-8dbe-7703ed698546 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:33.073466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312be8b-88b7-4ae3-a67f-e7e00ea7cb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:33.074310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312be8b-88b7-4ae3-a67f-e7e00ea7cb32 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:33.074608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312be8b-88b7-4ae3-a67f-e7e00ea7cb32 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:33.074874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312be8b-88b7-4ae3-a67f-e7e00ea7cb32 None admin] PATH_INFO: `/v3/domains/14986379766c4a10a04b8660f7ad3ee8` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:33.085512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312be8b-88b7-4ae3-a67f-e7e00ea7cb32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=14986379766c4a10a04b8660f7ad3ee8)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:33.086999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312be8b-88b7-4ae3-a67f-e7e00ea7cb32 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:33.088672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 593/1172] 10.222.0.35 () {56 vars in 1183 bytes} [Wed May 4 18:45:32 2022] GET /identity/v3/domains/14986379766c4a10a04b8660f7ad3ee8 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:33.094878 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4f409-e20f-4799-8b82-ba2117d44c56 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:33.203720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4f409-e20f-4799-8b82-ba2117d44c56 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:33.241398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5908d5b-3fa0-4e04-946e-2a99ba90556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:33.242083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908d5b-3fa0-4e04-946e-2a99ba90556b None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:33.242363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908d5b-3fa0-4e04-946e-2a99ba90556b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:33.242638 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908d5b-3fa0-4e04-946e-2a99ba90556b None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:33.243341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5908d5b-3fa0-4e04-946e-2a99ba90556b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:33.244779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5908d5b-3fa0-4e04-946e-2a99ba90556b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:33.278659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 580/1173] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:45:33 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:45:35.576703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eae9e-3054-488e-8730-1574ec52791c None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:35.577353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eae9e-3054-488e-8730-1574ec52791c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:35.577353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eae9e-3054-488e-8730-1574ec52791c None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:35.578801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 594/1174] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:35.585650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160dbc8-f20e-420e-9f2b-f1a36284fbd3 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:35.586377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160dbc8-f20e-420e-9f2b-f1a36284fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:35.586517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160dbc8-f20e-420e-9f2b-f1a36284fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:35.607972 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9160dbc8-f20e-420e-9f2b-f1a36284fbd3 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:35.609171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9160dbc8-f20e-420e-9f2b-f1a36284fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:35.678742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 581/1175] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:35.707123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eae9e-3054-488e-8730-1574ec52791c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:35.810992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eae9e-3054-488e-8730-1574ec52791c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:35.843925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce622db-0f4e-45fc-be72-585da4f3ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:35.844810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce622db-0f4e-45fc-be72-585da4f3ec5c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:35.845081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce622db-0f4e-45fc-be72-585da4f3ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:35.845390 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce622db-0f4e-45fc-be72-585da4f3ec5c None admin] PATH_INFO: `/v3/domains/14986379766c4a10a04b8660f7ad3ee8` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:35.846599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce622db-0f4e-45fc-be72-585da4f3ec5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=14986379766c4a10a04b8660f7ad3ee8)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:35.848022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce622db-0f4e-45fc-be72-585da4f3ec5c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:35.849701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 595/1176] 10.222.0.35 () {56 vars in 1183 bytes} [Wed May 4 18:45:35 2022] GET /identity/v3/domains/14986379766c4a10a04b8660f7ad3ee8 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:35.855952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160dbc8-f20e-420e-9f2b-f1a36284fbd3 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:35.973848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160dbc8-f20e-420e-9f2b-f1a36284fbd3 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:36.009063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258fcc7-3430-49d5-aa53-d8ce9f93c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:36.009759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258fcc7-3430-49d5-aa53-d8ce9f93c040 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:36.010042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258fcc7-3430-49d5-aa53-d8ce9f93c040 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:36.010316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258fcc7-3430-49d5-aa53-d8ce9f93c040 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:36.011024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258fcc7-3430-49d5-aa53-d8ce9f93c040 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:36.012468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258fcc7-3430-49d5-aa53-d8ce9f93c040 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:36.041812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 582/1177] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:45:35 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:45:38.330227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206273c-3a5b-4605-b98c-d307437d7c7f None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:38.331115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206273c-3a5b-4605-b98c-d307437d7c7f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:38.331115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206273c-3a5b-4605-b98c-d307437d7c7f None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:38.333338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 596/1178] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:38.338994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c71db1-559e-4cd4-88b3-dbdf32fd2f30 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:38.339435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c71db1-559e-4cd4-88b3-dbdf32fd2f30 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:38.339533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c71db1-559e-4cd4-88b3-dbdf32fd2f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:38.357984 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-e2c71db1-559e-4cd4-88b3-dbdf32fd2f30 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:38.359159 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e2c71db1-559e-4cd4-88b3-dbdf32fd2f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:38.435394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 583/1179] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:38.464435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206273c-3a5b-4605-b98c-d307437d7c7f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:38.568123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206273c-3a5b-4605-b98c-d307437d7c7f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:38.601172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43a1f-8d4e-4233-b02e-fce313c53164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:38.601924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43a1f-8d4e-4233-b02e-fce313c53164 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:38.602207 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43a1f-8d4e-4233-b02e-fce313c53164 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:38.602479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43a1f-8d4e-4233-b02e-fce313c53164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:38.613133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b43a1f-8d4e-4233-b02e-fce313c53164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a8b43a1f-8d4e-4233-b02e-fce313c53164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:45:38.620731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:45:38.621974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:45:38.622922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 597/1180] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:45:38.629620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c71db1-559e-4cd4-88b3-dbdf32fd2f30 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:38.736988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c71db1-559e-4cd4-88b3-dbdf32fd2f30 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:38.778168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d7055-7a45-4627-8905-364df6f425a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:38.779197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d7055-7a45-4627-8905-364df6f425a6 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:38.779645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d7055-7a45-4627-8905-364df6f425a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:38.780092 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d7055-7a45-4627-8905-364df6f425a6 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:38.781443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d7055-7a45-4627-8905-364df6f425a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:38.781947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d7055-7a45-4627-8905-364df6f425a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:38.783659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d7055-7a45-4627-8905-364df6f425a6 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:38.792216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 584/1181] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:45:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:38.798504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43a1f-8d4e-4233-b02e-fce313c53164 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:38.898717 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43a1f-8d4e-4233-b02e-fce313c53164 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:38.934348 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffb601-a451-4baa-9727-e9ef1c7d444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:38.935219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffb601-a451-4baa-9727-e9ef1c7d444a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:38.935495 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffb601-a451-4baa-9727-e9ef1c7d444a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:38.935812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffb601-a451-4baa-9727-e9ef1c7d444a None admin] PATH_INFO: `/v3/users/9e1a85e6fc32407bb7f7034b04eda5c4` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:38.950242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffb601-a451-4baa-9727-e9ef1c7d444a None admin] RBAC: Authorizing `identity:get_user(user_id=9e1a85e6fc32407bb7f7034b04eda5c4)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:38.952121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffb601-a451-4baa-9727-e9ef1c7d444a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:38.953809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 598/1182] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:38 2022] GET /identity/v3/users/9e1a85e6fc32407bb7f7034b04eda5c4 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:38.963167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d7055-7a45-4627-8905-364df6f425a6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:39.080082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d7055-7a45-4627-8905-364df6f425a6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:39.113255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723c75-7099-450c-816c-526cbced4784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:39.113943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723c75-7099-450c-816c-526cbced4784 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:39.114279 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723c75-7099-450c-816c-526cbced4784 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:39.114516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723c75-7099-450c-816c-526cbced4784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:39.180162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15723c75-7099-450c-816c-526cbced4784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:39.181575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15723c75-7099-450c-816c-526cbced4784 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:39.282846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 585/1183] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:45:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:45:39.289143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffb601-a451-4baa-9727-e9ef1c7d444a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:39.399237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffb601-a451-4baa-9727-e9ef1c7d444a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:39.437662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a9f3c-4c07-473a-980f-1b0dcab0f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:39.438496 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a9f3c-4c07-473a-980f-1b0dcab0f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:39.438858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a9f3c-4c07-473a-980f-1b0dcab0f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:39.439130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a9f3c-4c07-473a-980f-1b0dcab0f2e5 None admin] PATH_INFO: `/v3/projects/146b6307068b4da4b1bf9977006fd0f2` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:39.440387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a9f3c-4c07-473a-980f-1b0dcab0f2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=146b6307068b4da4b1bf9977006fd0f2)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:39.441869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a9f3c-4c07-473a-980f-1b0dcab0f2e5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:39.443613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 599/1184] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:45:39 2022] GET /identity/v3/projects/146b6307068b4da4b1bf9977006fd0f2 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:39.450101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723c75-7099-450c-816c-526cbced4784 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:39.551114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723c75-7099-450c-816c-526cbced4784 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:39.584632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640db390-10bb-42ec-88ab-6c97b3ad8e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:39.585330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640db390-10bb-42ec-88ab-6c97b3ad8e85 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:39.585598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640db390-10bb-42ec-88ab-6c97b3ad8e85 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:39.585866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640db390-10bb-42ec-88ab-6c97b3ad8e85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:39.586714 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640db390-10bb-42ec-88ab-6c97b3ad8e85 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=146b6307068b4da4b1bf9977006fd0f2, user.id=9e1a85e6fc32407bb7f7034b04eda5c4) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:39.587020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640db390-10bb-42ec-88ab-6c97b3ad8e85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:39.588479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640db390-10bb-42ec-88ab-6c97b3ad8e85 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:39.594270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 586/1185] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:45:39 2022] GET /identity/v3/role_assignments?user.id=9e1a85e6fc32407bb7f7034b04eda5c4&scope.project.id=146b6307068b4da4b1bf9977006fd0f2&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:41.791880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d93c-228e-416f-a64a-4cfc539a1ed0 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:41.792781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d93c-228e-416f-a64a-4cfc539a1ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:41.792781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d93c-228e-416f-a64a-4cfc539a1ed0 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:41.794988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 600/1186] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:41.800799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730865d-78c7-4201-bf21-eaf4b65df323 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:41.801241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730865d-78c7-4201-bf21-eaf4b65df323 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:41.801352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730865d-78c7-4201-bf21-eaf4b65df323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:41.820388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7730865d-78c7-4201-bf21-eaf4b65df323 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:41.821626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7730865d-78c7-4201-bf21-eaf4b65df323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:41.889853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 587/1187] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:41.919708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d93c-228e-416f-a64a-4cfc539a1ed0 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:42.022100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d93c-228e-416f-a64a-4cfc539a1ed0 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:42.055506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0ed1d-edd9-46d1-8b5b-55ed0c10c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:42.056214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0ed1d-edd9-46d1-8b5b-55ed0c10c311 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:42.056489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0ed1d-edd9-46d1-8b5b-55ed0c10c311 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:42.056759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0ed1d-edd9-46d1-8b5b-55ed0c10c311 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:42.067263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0ed1d-edd9-46d1-8b5b-55ed0c10c311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-30c0ed1d-edd9-46d1-8b5b-55ed0c10c311 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:45:42.074764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:45:42.075813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:45:42.076960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 601/1188] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:45:42.085108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730865d-78c7-4201-bf21-eaf4b65df323 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:42.189250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730865d-78c7-4201-bf21-eaf4b65df323 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:42.237321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755471c8-94e5-4ac6-afda-d5c4e740d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:42.238011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755471c8-94e5-4ac6-afda-d5c4e740d57f None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:42.238292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755471c8-94e5-4ac6-afda-d5c4e740d57f None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:42.238566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755471c8-94e5-4ac6-afda-d5c4e740d57f None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:42.239321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755471c8-94e5-4ac6-afda-d5c4e740d57f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:42.239630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755471c8-94e5-4ac6-afda-d5c4e740d57f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:42.241003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755471c8-94e5-4ac6-afda-d5c4e740d57f None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:42.249545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 588/1189] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:45:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:42.255991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0ed1d-edd9-46d1-8b5b-55ed0c10c311 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:42.365619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0ed1d-edd9-46d1-8b5b-55ed0c10c311 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:42.399291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfff9b-cae9-47d7-8299-46044ad2f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:42.400159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfff9b-cae9-47d7-8299-46044ad2f416 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:42.400441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfff9b-cae9-47d7-8299-46044ad2f416 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:42.400710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfff9b-cae9-47d7-8299-46044ad2f416 None admin] PATH_INFO: `/v3/users/9e1a85e6fc32407bb7f7034b04eda5c4` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:42.402042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfff9b-cae9-47d7-8299-46044ad2f416 None admin] RBAC: Authorizing `identity:get_user(user_id=9e1a85e6fc32407bb7f7034b04eda5c4)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:42.403482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfff9b-cae9-47d7-8299-46044ad2f416 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:42.405080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 602/1190] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:42 2022] GET /identity/v3/users/9e1a85e6fc32407bb7f7034b04eda5c4 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:42.411386 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755471c8-94e5-4ac6-afda-d5c4e740d57f None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:42.525106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755471c8-94e5-4ac6-afda-d5c4e740d57f None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:42.562561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c436c-77cf-43d2-806c-49cd8e59d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:42.563438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c436c-77cf-43d2-806c-49cd8e59d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:42.563716 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c436c-77cf-43d2-806c-49cd8e59d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:42.563989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c436c-77cf-43d2-806c-49cd8e59d6b3 None admin] PATH_INFO: `/v3/projects/146b6307068b4da4b1bf9977006fd0f2` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:42.565217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c436c-77cf-43d2-806c-49cd8e59d6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=146b6307068b4da4b1bf9977006fd0f2)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:42.566696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c436c-77cf-43d2-806c-49cd8e59d6b3 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:42.568371 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 589/1191] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:45:42 2022] GET /identity/v3/projects/146b6307068b4da4b1bf9977006fd0f2 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:42.574672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfff9b-cae9-47d7-8299-46044ad2f416 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:42.671901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfff9b-cae9-47d7-8299-46044ad2f416 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:42.709623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08b1da-6f6f-458d-a6a1-861f672c0f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:42.711015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08b1da-6f6f-458d-a6a1-861f672c0f5d None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:42.711416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08b1da-6f6f-458d-a6a1-861f672c0f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:42.711866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08b1da-6f6f-458d-a6a1-861f672c0f5d None admin] PATH_INFO: `/v3/projects/146b6307068b4da4b1bf9977006fd0f2/users/9e1a85e6fc32407bb7f7034b04eda5c4/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:42.715497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08b1da-6f6f-458d-a6a1-861f672c0f5d None admin] RBAC: Authorizing `identity:create_grant(project_id=146b6307068b4da4b1bf9977006fd0f2, user_id=9e1a85e6fc32407bb7f7034b04eda5c4, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:42.717853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08b1da-6f6f-458d-a6a1-861f672c0f5d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:42.738721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 603/1192] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:45:42 2022] PUT /identity/v3/projects/146b6307068b4da4b1bf9977006fd0f2/users/9e1a85e6fc32407bb7f7034b04eda5c4/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:45:44.916624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d3e4-67f5-4b89-995c-91498e96d3bb None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:44.917170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d3e4-67f5-4b89-995c-91498e96d3bb None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:44.917170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d3e4-67f5-4b89-995c-91498e96d3bb None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:44.919407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 590/1193] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:45:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:45:44.928657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6302068-db96-4e3c-ae7a-c208ea753538 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:44.929567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6302068-db96-4e3c-ae7a-c208ea753538 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:44.930390 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6302068-db96-4e3c-ae7a-c208ea753538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:44.951891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b6302068-db96-4e3c-ae7a-c208ea753538 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:45:44.953081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b6302068-db96-4e3c-ae7a-c208ea753538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:45:45.022162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 604/1194] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:45:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:45:45.046185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d3e4-67f5-4b89-995c-91498e96d3bb None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:45.160101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d3e4-67f5-4b89-995c-91498e96d3bb None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:45.193133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fc7e1-e452-41f8-bdf6-0555e23be595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:45.193885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fc7e1-e452-41f8-bdf6-0555e23be595 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:45.194168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fc7e1-e452-41f8-bdf6-0555e23be595 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:45.194441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fc7e1-e452-41f8-bdf6-0555e23be595 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:45.205049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fc7e1-e452-41f8-bdf6-0555e23be595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-bd3fc7e1-e452-41f8-bdf6-0555e23be595 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:45:45.212569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:45:45.213629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:45:45.214515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 591/1195] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:45:45.220404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6302068-db96-4e3c-ae7a-c208ea753538 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:45.318139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6302068-db96-4e3c-ae7a-c208ea753538 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:45.351619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f077-3ed7-40cd-887b-3e4d0d7b755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:45.352267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f077-3ed7-40cd-887b-3e4d0d7b755c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:45.352548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f077-3ed7-40cd-887b-3e4d0d7b755c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:45.352821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f077-3ed7-40cd-887b-3e4d0d7b755c None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:45.353620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210f077-3ed7-40cd-887b-3e4d0d7b755c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:45.353927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210f077-3ed7-40cd-887b-3e4d0d7b755c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:45.355308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210f077-3ed7-40cd-887b-3e4d0d7b755c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:45.363332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 605/1196] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:45.369525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fc7e1-e452-41f8-bdf6-0555e23be595 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:45.475956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fc7e1-e452-41f8-bdf6-0555e23be595 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:45.510494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45a39-3d36-4463-aed5-ca404dfd1d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:45.511343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45a39-3d36-4463-aed5-ca404dfd1d09 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:45.511632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45a39-3d36-4463-aed5-ca404dfd1d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:45.511898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45a39-3d36-4463-aed5-ca404dfd1d09 None admin] PATH_INFO: `/v3/users/9e1a85e6fc32407bb7f7034b04eda5c4` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:45.513119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d45a39-3d36-4463-aed5-ca404dfd1d09 None admin] RBAC: Authorizing `identity:get_user(user_id=9e1a85e6fc32407bb7f7034b04eda5c4)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:45.514569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d45a39-3d36-4463-aed5-ca404dfd1d09 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:45.516242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 592/1197] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 4 18:45:45 2022] GET /identity/v3/users/9e1a85e6fc32407bb7f7034b04eda5c4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:45.522297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f077-3ed7-40cd-887b-3e4d0d7b755c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:45.618753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f077-3ed7-40cd-887b-3e4d0d7b755c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:45.656758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d90dd-1df8-4c03-b192-ba649d9169c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:45.657475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d90dd-1df8-4c03-b192-ba649d9169c1 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:45.657754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d90dd-1df8-4c03-b192-ba649d9169c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:45.658027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d90dd-1df8-4c03-b192-ba649d9169c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:45.723744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d90dd-1df8-4c03-b192-ba649d9169c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:45.725223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d90dd-1df8-4c03-b192-ba649d9169c1 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:45.822509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 606/1198] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:45:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:45:45.829032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45a39-3d36-4463-aed5-ca404dfd1d09 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:45.936833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45a39-3d36-4463-aed5-ca404dfd1d09 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:45.973930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311d662-b09a-4cfe-bf8d-2d0637590a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:45.974719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d662-b09a-4cfe-bf8d-2d0637590a80 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:45.974985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d662-b09a-4cfe-bf8d-2d0637590a80 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:45.975251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d662-b09a-4cfe-bf8d-2d0637590a80 None admin] PATH_INFO: `/v3/projects/146b6307068b4da4b1bf9977006fd0f2` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:45.976533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311d662-b09a-4cfe-bf8d-2d0637590a80 None admin] RBAC: Authorizing `identity:get_project(project_id=146b6307068b4da4b1bf9977006fd0f2)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:45.977970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311d662-b09a-4cfe-bf8d-2d0637590a80 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:45.979621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 593/1199] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 4 18:45:45 2022] GET /identity/v3/projects/146b6307068b4da4b1bf9977006fd0f2 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:45:45.985995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d90dd-1df8-4c03-b192-ba649d9169c1 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:45:46.086104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d90dd-1df8-4c03-b192-ba649d9169c1 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:45:46.123767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adec62-1f62-4c22-ad82-5bf627f3327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:45:46.124408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adec62-1f62-4c22-ad82-5bf627f3327e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:45:46.124684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adec62-1f62-4c22-ad82-5bf627f3327e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:45:46.124952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adec62-1f62-4c22-ad82-5bf627f3327e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:45:46.125830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adec62-1f62-4c22-ad82-5bf627f3327e None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=146b6307068b4da4b1bf9977006fd0f2, user.id=9e1a85e6fc32407bb7f7034b04eda5c4) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:45:46.126205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adec62-1f62-4c22-ad82-5bf627f3327e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:45:46.128656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adec62-1f62-4c22-ad82-5bf627f3327e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:45:46.135346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 607/1200] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:45:45 2022] GET /identity/v3/role_assignments?user.id=9e1a85e6fc32407bb7f7034b04eda5c4&scope.project.id=146b6307068b4da4b1bf9977006fd0f2&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:46.775892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4184a2-d761-40a8-940d-21722d0e699f None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:46.776712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4184a2-d761-40a8-940d-21722d0e699f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:46.776712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4184a2-d761-40a8-940d-21722d0e699f None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:46.777945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 594/1201] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:46:46.795223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3f3c0-cbf2-4211-8854-7addaa45a9bf None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:46.795838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3f3c0-cbf2-4211-8854-7addaa45a9bf None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:46.795838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3f3c0-cbf2-4211-8854-7addaa45a9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:46.815846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-03b3f3c0-cbf2-4211-8854-7addaa45a9bf None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:46:46.822577 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-03b3f3c0-cbf2-4211-8854-7addaa45a9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:46:46.913330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 608/1202] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:46:46.940948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4184a2-d761-40a8-940d-21722d0e699f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:47.066042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4184a2-d761-40a8-940d-21722d0e699f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:47.104966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a5958-918a-4a03-b832-2cd22624dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:47.105889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a5958-918a-4a03-b832-2cd22624dca0 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:47.106171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a5958-918a-4a03-b832-2cd22624dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:47.106471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a5958-918a-4a03-b832-2cd22624dca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:47.118136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a5958-918a-4a03-b832-2cd22624dca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:47.119757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a5958-918a-4a03-b832-2cd22624dca0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-d42a5958-918a-4a03-b832-2cd22624dca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:46:47.139603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:47.140853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:47.141955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:46:47.141955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:46:47.141955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:47.141955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:46:47.141955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 595/1203] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:47.147523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3f3c0-cbf2-4211-8854-7addaa45a9bf None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:47.274288 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3f3c0-cbf2-4211-8854-7addaa45a9bf None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:47.318084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e76e2a-cbab-48ad-9f06-5d3e6590258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:47.318737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76e2a-cbab-48ad-9f06-5d3e6590258d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:47.319019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76e2a-cbab-48ad-9f06-5d3e6590258d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:47.319291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76e2a-cbab-48ad-9f06-5d3e6590258d None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:47.320011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e76e2a-cbab-48ad-9f06-5d3e6590258d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:47.320329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e76e2a-cbab-48ad-9f06-5d3e6590258d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:47.321722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e76e2a-cbab-48ad-9f06-5d3e6590258d None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:47.335033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 609/1204] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:46:47.341439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a5958-918a-4a03-b832-2cd22624dca0 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:47.467599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a5958-918a-4a03-b832-2cd22624dca0 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:47.508450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1010526-1c55-4710-b52b-2c433019f1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:47.509305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1010526-1c55-4710-b52b-2c433019f1f0 None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:47.509590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1010526-1c55-4710-b52b-2c433019f1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:47.509868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1010526-1c55-4710-b52b-2c433019f1f0 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:47.510575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1010526-1c55-4710-b52b-2c433019f1f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:47.512029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1010526-1c55-4710-b52b-2c433019f1f0 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:47.546358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 596/1205] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 4 18:46:47 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:46:50.082474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00cfa9-992d-4340-8ff9-a8ad9c222856 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:50.083071 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00cfa9-992d-4340-8ff9-a8ad9c222856 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:50.083071 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00cfa9-992d-4340-8ff9-a8ad9c222856 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:50.084415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 610/1206] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:46:50.090662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f5d1-fe0f-4af9-9ad0-e9eff83abcdc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:50.091088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f5d1-fe0f-4af9-9ad0-e9eff83abcdc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:50.091281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f5d1-fe0f-4af9-9ad0-e9eff83abcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:50.110704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-85d3f5d1-fe0f-4af9-9ad0-e9eff83abcdc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:46:50.112213 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-85d3f5d1-fe0f-4af9-9ad0-e9eff83abcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:46:50.189317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 597/1207] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:46:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:46:50.212978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00cfa9-992d-4340-8ff9-a8ad9c222856 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:50.329994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00cfa9-992d-4340-8ff9-a8ad9c222856 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:50.373725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0705a66-3c00-47a1-a551-9bdd50fc632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:50.374566 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0705a66-3c00-47a1-a551-9bdd50fc632f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:50.374870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0705a66-3c00-47a1-a551-9bdd50fc632f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:50.375232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0705a66-3c00-47a1-a551-9bdd50fc632f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:50.391803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0705a66-3c00-47a1-a551-9bdd50fc632f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-b0705a66-3c00-47a1-a551-9bdd50fc632f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:46:50.402046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:50.403290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:46:50.404546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:46:50.409512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 611/1208] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:46:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:50.410473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3f5d1-fe0f-4af9-9ad0-e9eff83abcdc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:50.522936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3f5d1-fe0f-4af9-9ad0-e9eff83abcdc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:50.567571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1e842-d567-460d-a0dc-f829a59094cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:50.568253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1e842-d567-460d-a0dc-f829a59094cf None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:50.568530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1e842-d567-460d-a0dc-f829a59094cf None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:50.568801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1e842-d567-460d-a0dc-f829a59094cf None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:50.569604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1e842-d567-460d-a0dc-f829a59094cf None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:50.569902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1e842-d567-460d-a0dc-f829a59094cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:50.571522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1e842-d567-460d-a0dc-f829a59094cf None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:50.587406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 598/1209] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:46:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:50.588560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0705a66-3c00-47a1-a551-9bdd50fc632f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:50.695833 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0705a66-3c00-47a1-a551-9bdd50fc632f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:50.731231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6f592-39be-4fad-8f70-d0208165311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:50.732023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6f592-39be-4fad-8f70-d0208165311c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:50.732347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6f592-39be-4fad-8f70-d0208165311c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:50.732763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6f592-39be-4fad-8f70-d0208165311c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:50.743708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6f592-39be-4fad-8f70-d0208165311c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:50.745184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6f592-39be-4fad-8f70-d0208165311c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-fcc6f592-39be-4fad-8f70-d0208165311c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:46:50.764680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:50.766159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:50.767549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:46:50.767549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:46:50.767549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:50.767549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:46:50.767549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 612/1210] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:46:50.772485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1e842-d567-460d-a0dc-f829a59094cf None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:50.891196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1e842-d567-460d-a0dc-f829a59094cf None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:50.926145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef625f-8673-4914-87a8-bfd7b2796c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:50.926821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef625f-8673-4914-87a8-bfd7b2796c87 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:50.927118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef625f-8673-4914-87a8-bfd7b2796c87 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:50.927357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef625f-8673-4914-87a8-bfd7b2796c87 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:50.928178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef625f-8673-4914-87a8-bfd7b2796c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:50.928387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef625f-8673-4914-87a8-bfd7b2796c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:50.929784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef625f-8673-4914-87a8-bfd7b2796c87 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:50.942163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 599/1211] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:50.947848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6f592-39be-4fad-8f70-d0208165311c None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:51.053133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6f592-39be-4fad-8f70-d0208165311c None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:51.088551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ddad5-ac9f-4cac-afc0-d31e1bd69a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:51.090727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ddad5-ac9f-4cac-afc0-d31e1bd69a73 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:51.090727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ddad5-ac9f-4cac-afc0-d31e1bd69a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:51.090727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ddad5-ac9f-4cac-afc0-d31e1bd69a73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:51.098288 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ddad5-ac9f-4cac-afc0-d31e1bd69a73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:51.099834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ddad5-ac9f-4cac-afc0-d31e1bd69a73 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-a15ddad5-ac9f-4cac-afc0-d31e1bd69a73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:46:51.114294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:51.115633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:46:51.116787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 613/1212] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:46:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:51.121493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef625f-8673-4914-87a8-bfd7b2796c87 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:51.235671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef625f-8673-4914-87a8-bfd7b2796c87 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:51.272381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811191bc-ae99-4c66-a857-9745dce86f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:51.273203 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811191bc-ae99-4c66-a857-9745dce86f9d None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:51.273633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811191bc-ae99-4c66-a857-9745dce86f9d None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:51.274001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811191bc-ae99-4c66-a857-9745dce86f9d None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:51.274986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811191bc-ae99-4c66-a857-9745dce86f9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:51.275392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811191bc-ae99-4c66-a857-9745dce86f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:51.276910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811191bc-ae99-4c66-a857-9745dce86f9d None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:51.296597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 600/1213] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 4 18:46:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:46:51.302532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ddad5-ac9f-4cac-afc0-d31e1bd69a73 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:51.410036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ddad5-ac9f-4cac-afc0-d31e1bd69a73 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:51.445414 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b31c-9d8c-44fe-8923-b5a284dbf2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:51.446067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b31c-9d8c-44fe-8923-b5a284dbf2fd None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:51.446345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b31c-9d8c-44fe-8923-b5a284dbf2fd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:51.446616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b31c-9d8c-44fe-8923-b5a284dbf2fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:51.517213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b31c-9d8c-44fe-8923-b5a284dbf2fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:51.518731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b31c-9d8c-44fe-8923-b5a284dbf2fd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:51.625315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 614/1214] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:46:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:46:51.629000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811191bc-ae99-4c66-a857-9745dce86f9d None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:51.749618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811191bc-ae99-4c66-a857-9745dce86f9d None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:51.795569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc8dd-36f3-4549-b8e3-6b860a854520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:51.796989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc8dd-36f3-4549-b8e3-6b860a854520 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:51.797729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc8dd-36f3-4549-b8e3-6b860a854520 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:51.798223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc8dd-36f3-4549-b8e3-6b860a854520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:51.815168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cc8dd-36f3-4549-b8e3-6b860a854520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:51.817248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cc8dd-36f3-4549-b8e3-6b860a854520 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-ed5cc8dd-36f3-4549-b8e3-6b860a854520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:46:51.839804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:51.841002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:51.842284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:46:51.842284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:46:51.842284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:51.842284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:46:51.847233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 601/1215] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:46:51.848564 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b31c-9d8c-44fe-8923-b5a284dbf2fd None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:51.961537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b31c-9d8c-44fe-8923-b5a284dbf2fd None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:51.997416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4e8c5-7b9e-4eb4-a03e-b8adc2cd2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:51.998250 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4e8c5-7b9e-4eb4-a03e-b8adc2cd2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:51.998594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4e8c5-7b9e-4eb4-a03e-b8adc2cd2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:51.998928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4e8c5-7b9e-4eb4-a03e-b8adc2cd2fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:51.999743 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4e8c5-7b9e-4eb4-a03e-b8adc2cd2fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:52.000160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4e8c5-7b9e-4eb4-a03e-b8adc2cd2fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:52.001669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4e8c5-7b9e-4eb4-a03e-b8adc2cd2fd5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:52.012960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 615/1216] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:52.018821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc8dd-36f3-4549-b8e3-6b860a854520 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:52.122901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc8dd-36f3-4549-b8e3-6b860a854520 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:52.160793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138223a-4e1f-4cec-9a71-2da877c2ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:52.161650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138223a-4e1f-4cec-9a71-2da877c2ab95 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:52.161920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138223a-4e1f-4cec-9a71-2da877c2ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:52.162219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138223a-4e1f-4cec-9a71-2da877c2ab95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:52.169273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138223a-4e1f-4cec-9a71-2da877c2ab95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:52.170867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138223a-4e1f-4cec-9a71-2da877c2ab95 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-5138223a-4e1f-4cec-9a71-2da877c2ab95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:46:52.190035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:52.191727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:52.197629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:46:52.197629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:46:52.197629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:46:52.197629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:46:52.197629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:46:52.197629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:46:52.197629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:46:52.197629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:46:52.197629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 602/1217] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:46:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:46:52.201504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4e8c5-7b9e-4eb4-a03e-b8adc2cd2fd5 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:52.306648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4e8c5-7b9e-4eb4-a03e-b8adc2cd2fd5 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:52.343669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5a70-63fc-4877-8934-1f1d1cd929a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:52.344499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5a70-63fc-4877-8934-1f1d1cd929a4 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:52.344793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5a70-63fc-4877-8934-1f1d1cd929a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:52.345052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5a70-63fc-4877-8934-1f1d1cd929a4 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:52.345895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d5a70-63fc-4877-8934-1f1d1cd929a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:52.346200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d5a70-63fc-4877-8934-1f1d1cd929a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:52.347657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d5a70-63fc-4877-8934-1f1d1cd929a4 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:52.361920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 616/1218] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:46:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:52.369653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138223a-4e1f-4cec-9a71-2da877c2ab95 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:52.480064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138223a-4e1f-4cec-9a71-2da877c2ab95 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:52.516806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9c9a9-8c05-4cda-af2d-4b2b67e41ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:52.518037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9c9a9-8c05-4cda-af2d-4b2b67e41ac4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:52.518533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9c9a9-8c05-4cda-af2d-4b2b67e41ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:52.519052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9c9a9-8c05-4cda-af2d-4b2b67e41ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:52.519961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9c9a9-8c05-4cda-af2d-4b2b67e41ac4 None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=f6eaf63f68734bdd938aa0ea7d0c4441) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:52.520280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9c9a9-8c05-4cda-af2d-4b2b67e41ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:52.521889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9c9a9-8c05-4cda-af2d-4b2b67e41ac4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:52.529784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 603/1219] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:46:52 2022] GET /identity/v3/role_assignments?user.id=f6eaf63f68734bdd938aa0ea7d0c4441&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:54.816615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24712cf-97a0-4192-86ca-8487c1b126f3 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:54.817469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24712cf-97a0-4192-86ca-8487c1b126f3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:54.817469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24712cf-97a0-4192-86ca-8487c1b126f3 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:54.818978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 617/1220] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 18:46:54.824373 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27757f6d-bdb6-47c6-8066-abb5820d502b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:54.824800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27757f6d-bdb6-47c6-8066-abb5820d502b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:54.824946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27757f6d-bdb6-47c6-8066-abb5820d502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:54.842535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-27757f6d-bdb6-47c6-8066-abb5820d502b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:46:54.843732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-27757f6d-bdb6-47c6-8066-abb5820d502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:46:54.917494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 604/1221] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:46:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:46:54.940182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24712cf-97a0-4192-86ca-8487c1b126f3 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:55.049595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24712cf-97a0-4192-86ca-8487c1b126f3 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:55.088662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01ef36-5690-41aa-b945-6417734577e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:55.089999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01ef36-5690-41aa-b945-6417734577e9 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:55.090339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01ef36-5690-41aa-b945-6417734577e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:55.090666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01ef36-5690-41aa-b945-6417734577e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:55.101314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01ef36-5690-41aa-b945-6417734577e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-8b01ef36-5690-41aa-b945-6417734577e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:46:55.109138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:55.110152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:46:55.111090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 618/1222] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:46:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:55.116421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27757f6d-bdb6-47c6-8066-abb5820d502b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:55.224688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27757f6d-bdb6-47c6-8066-abb5820d502b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:55.261437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d928106-e4d6-4d1d-a0d2-98cfd31f90ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:55.262230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928106-e4d6-4d1d-a0d2-98cfd31f90ae None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:55.262508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928106-e4d6-4d1d-a0d2-98cfd31f90ae None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:55.262777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928106-e4d6-4d1d-a0d2-98cfd31f90ae None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:55.263528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928106-e4d6-4d1d-a0d2-98cfd31f90ae None admin] RBAC: Adding query filter params (name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:55.263936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928106-e4d6-4d1d-a0d2-98cfd31f90ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:55.265315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928106-e4d6-4d1d-a0d2-98cfd31f90ae None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:55.274905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 605/1223] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:55.281468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01ef36-5690-41aa-b945-6417734577e9 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:55.392620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01ef36-5690-41aa-b945-6417734577e9 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:55.430180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1728d-c242-4f8d-a9f8-cacd1997ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:55.431096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1728d-c242-4f8d-a9f8-cacd1997ac70 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:55.431462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1728d-c242-4f8d-a9f8-cacd1997ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:55.431828 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1728d-c242-4f8d-a9f8-cacd1997ac70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:55.444019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1728d-c242-4f8d-a9f8-cacd1997ac70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:55.445838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1728d-c242-4f8d-a9f8-cacd1997ac70 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-0cb1728d-c242-4f8d-a9f8-cacd1997ac70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:46:55.464252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:55.465374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:55.466353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:46:55.466353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:46:55.466353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:55.466353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:46:55.466353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 619/1224] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:55.471436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d928106-e4d6-4d1d-a0d2-98cfd31f90ae None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:55.581780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d928106-e4d6-4d1d-a0d2-98cfd31f90ae None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:55.616546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb01f8-78a0-4f3b-b011-6b47e6fd3cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:55.617214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb01f8-78a0-4f3b-b011-6b47e6fd3cde None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:55.617520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb01f8-78a0-4f3b-b011-6b47e6fd3cde None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:55.617797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb01f8-78a0-4f3b-b011-6b47e6fd3cde None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:55.618538 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb01f8-78a0-4f3b-b011-6b47e6fd3cde None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:55.618838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb01f8-78a0-4f3b-b011-6b47e6fd3cde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:55.620217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb01f8-78a0-4f3b-b011-6b47e6fd3cde None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:55.633513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 606/1225] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:55.640031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1728d-c242-4f8d-a9f8-cacd1997ac70 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:55.748956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1728d-c242-4f8d-a9f8-cacd1997ac70 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:55.787408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729b748-297f-4828-bc02-52083a1c18e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:55.788213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729b748-297f-4828-bc02-52083a1c18e6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:55.788490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729b748-297f-4828-bc02-52083a1c18e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:55.788757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729b748-297f-4828-bc02-52083a1c18e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:55.800208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729b748-297f-4828-bc02-52083a1c18e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:55.802187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729b748-297f-4828-bc02-52083a1c18e6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-4729b748-297f-4828-bc02-52083a1c18e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:46:55.819143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:55.820757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:46:55.821759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 620/1226] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:46:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:55.827547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb01f8-78a0-4f3b-b011-6b47e6fd3cde None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:55.930464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb01f8-78a0-4f3b-b011-6b47e6fd3cde None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:55.967936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03332db5-5aa5-4d74-9d36-8bf8a4eeddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:55.968608 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03332db5-5aa5-4d74-9d36-8bf8a4eeddb2 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:55.968948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03332db5-5aa5-4d74-9d36-8bf8a4eeddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:55.969202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03332db5-5aa5-4d74-9d36-8bf8a4eeddb2 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:55.970092 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03332db5-5aa5-4d74-9d36-8bf8a4eeddb2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:55.970396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03332db5-5aa5-4d74-9d36-8bf8a4eeddb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:55.971961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03332db5-5aa5-4d74-9d36-8bf8a4eeddb2 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:55.988756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 607/1227] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 4 18:46:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:46:55.994658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729b748-297f-4828-bc02-52083a1c18e6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:56.102595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729b748-297f-4828-bc02-52083a1c18e6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:56.142385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f9b0a-5a30-4108-994d-fc473ce6b210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:56.143399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f9b0a-5a30-4108-994d-fc473ce6b210 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:56.143717 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f9b0a-5a30-4108-994d-fc473ce6b210 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:56.144096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f9b0a-5a30-4108-994d-fc473ce6b210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:56.155748 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f9b0a-5a30-4108-994d-fc473ce6b210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:56.157404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f9b0a-5a30-4108-994d-fc473ce6b210 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-ae2f9b0a-5a30-4108-994d-fc473ce6b210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:46:56.175859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:56.177036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:56.178257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:46:56.178257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:46:56.178257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:56.178257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:46:56.178655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 621/1228] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:56.184664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03332db5-5aa5-4d74-9d36-8bf8a4eeddb2 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:56.291598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03332db5-5aa5-4d74-9d36-8bf8a4eeddb2 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:56.326830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd8cb9-743f-490b-a2af-c285194cd0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:56.327495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd8cb9-743f-490b-a2af-c285194cd0ca None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:56.327775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd8cb9-743f-490b-a2af-c285194cd0ca None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:56.328096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd8cb9-743f-490b-a2af-c285194cd0ca None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:56.328868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd8cb9-743f-490b-a2af-c285194cd0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:56.329217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd8cb9-743f-490b-a2af-c285194cd0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:56.330646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd8cb9-743f-490b-a2af-c285194cd0ca None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:56.342303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 608/1229] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:56.348126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f9b0a-5a30-4108-994d-fc473ce6b210 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:56.458963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f9b0a-5a30-4108-994d-fc473ce6b210 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:56.493355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446d7ae-6b17-487b-96da-74882d303c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:56.494379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446d7ae-6b17-487b-96da-74882d303c2f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:56.494765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446d7ae-6b17-487b-96da-74882d303c2f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:56.495140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446d7ae-6b17-487b-96da-74882d303c2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:56.503848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446d7ae-6b17-487b-96da-74882d303c2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:56.505724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446d7ae-6b17-487b-96da-74882d303c2f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-f446d7ae-6b17-487b-96da-74882d303c2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:46:56.520638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:56.521804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:56.522772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:46:56.522772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:46:56.522772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:46:56.522772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:46:56.522772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:46:56.522772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:46:56.522772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:46:56.522772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:46:56.522772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 622/1230] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:56.528883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd8cb9-743f-490b-a2af-c285194cd0ca None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:56.629931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd8cb9-743f-490b-a2af-c285194cd0ca None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:56.668051 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dd869-f891-4f53-92ef-b3d3cdc78079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:56.668860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dd869-f891-4f53-92ef-b3d3cdc78079 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:56.669170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dd869-f891-4f53-92ef-b3d3cdc78079 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:56.669547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dd869-f891-4f53-92ef-b3d3cdc78079 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:56.670475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dd869-f891-4f53-92ef-b3d3cdc78079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:56.671102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dd869-f891-4f53-92ef-b3d3cdc78079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:56.673623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dd869-f891-4f53-92ef-b3d3cdc78079 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:56.689247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 609/1231] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:56.695692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446d7ae-6b17-487b-96da-74882d303c2f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:56.807588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446d7ae-6b17-487b-96da-74882d303c2f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:56.847353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d721ce-e229-46de-80ee-5a3b54eadaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:56.848308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d721ce-e229-46de-80ee-5a3b54eadaf6 None admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:56.848589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d721ce-e229-46de-80ee-5a3b54eadaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:56.848866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d721ce-e229-46de-80ee-5a3b54eadaf6 None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/f6eaf63f68734bdd938aa0ea7d0c4441/roles/b2763aed3ee84a9a9c5186ecada8844f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:56.864840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d721ce-e229-46de-80ee-5a3b54eadaf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=f6eaf63f68734bdd938aa0ea7d0c4441, role_id=b2763aed3ee84a9a9c5186ecada8844f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:56.866453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d721ce-e229-46de-80ee-5a3b54eadaf6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:56.879422 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 623/1232] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:46:56 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/f6eaf63f68734bdd938aa0ea7d0c4441/roles/b2763aed3ee84a9a9c5186ecada8844f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:46:59.088225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668c87-bc1b-442f-b13e-66e30deee6dc None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:59.088807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668c87-bc1b-442f-b13e-66e30deee6dc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:59.088807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668c87-bc1b-442f-b13e-66e30deee6dc None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:59.090311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 610/1233] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:46:59.095726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641213ab-69ab-4300-9dfd-9ba4123235cf None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:59.096483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641213ab-69ab-4300-9dfd-9ba4123235cf None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:59.096483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641213ab-69ab-4300-9dfd-9ba4123235cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:59.112543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-641213ab-69ab-4300-9dfd-9ba4123235cf None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:46:59.113824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-641213ab-69ab-4300-9dfd-9ba4123235cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:46:59.189594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 624/1234] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:46:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:46:59.213039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668c87-bc1b-442f-b13e-66e30deee6dc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:59.324383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668c87-bc1b-442f-b13e-66e30deee6dc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:59.357694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eae394-91f4-48a6-b011-bb0f57d7e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:59.358518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eae394-91f4-48a6-b011-bb0f57d7e9cb None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:59.358770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eae394-91f4-48a6-b011-bb0f57d7e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:59.359049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eae394-91f4-48a6-b011-bb0f57d7e9cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:59.369269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eae394-91f4-48a6-b011-bb0f57d7e9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-13eae394-91f4-48a6-b011-bb0f57d7e9cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:46:59.377505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:59.379319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:46:59.380500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 611/1235] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 4 18:46:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:59.385324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641213ab-69ab-4300-9dfd-9ba4123235cf None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:59.492590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641213ab-69ab-4300-9dfd-9ba4123235cf None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:59.532174 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adc179-fa62-4b0f-be29-b6010ff30487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:59.532850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc179-fa62-4b0f-be29-b6010ff30487 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:59.533133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc179-fa62-4b0f-be29-b6010ff30487 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:59.533441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc179-fa62-4b0f-be29-b6010ff30487 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:59.534194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adc179-fa62-4b0f-be29-b6010ff30487 None admin] RBAC: Adding query filter params (name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:59.534527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adc179-fa62-4b0f-be29-b6010ff30487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:59.536279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adc179-fa62-4b0f-be29-b6010ff30487 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:59.545064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 625/1236] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 4 18:46:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:46:59.550938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eae394-91f4-48a6-b011-bb0f57d7e9cb None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:59.661377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eae394-91f4-48a6-b011-bb0f57d7e9cb None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:59.696998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ecb63-113c-41a9-afc6-973aa5f6716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:59.697842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ecb63-113c-41a9-afc6-973aa5f6716e None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:59.698119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ecb63-113c-41a9-afc6-973aa5f6716e None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:59.698391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ecb63-113c-41a9-afc6-973aa5f6716e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:59.708772 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ecb63-113c-41a9-afc6-973aa5f6716e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:59.710260 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ecb63-113c-41a9-afc6-973aa5f6716e None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8a7ecb63-113c-41a9-afc6-973aa5f6716e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:46:59.726369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:46:59.727596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:46:59.728625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:46:59.728625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:46:59.728625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:46:59.728625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:46:59.728625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 612/1237] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:46:59.733716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adc179-fa62-4b0f-be29-b6010ff30487 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:46:59.852040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adc179-fa62-4b0f-be29-b6010ff30487 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:46:59.891896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2daeb4-7d98-4cbd-a5e6-1bd1045d0f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:46:59.892561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2daeb4-7d98-4cbd-a5e6-1bd1045d0f05 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:46:59.892840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2daeb4-7d98-4cbd-a5e6-1bd1045d0f05 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:46:59.893118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2daeb4-7d98-4cbd-a5e6-1bd1045d0f05 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:46:59.893887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2daeb4-7d98-4cbd-a5e6-1bd1045d0f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:46:59.894325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2daeb4-7d98-4cbd-a5e6-1bd1045d0f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:46:59.895555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2daeb4-7d98-4cbd-a5e6-1bd1045d0f05 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:46:59.907208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 626/1238] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:46:59.913098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ecb63-113c-41a9-afc6-973aa5f6716e None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:00.016492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ecb63-113c-41a9-afc6-973aa5f6716e None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:00.051950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ffebd-4de0-457d-bbc4-681138a6560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:00.052703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ffebd-4de0-457d-bbc4-681138a6560a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:00.053022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ffebd-4de0-457d-bbc4-681138a6560a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:00.053351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ffebd-4de0-457d-bbc4-681138a6560a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:00.060951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ffebd-4de0-457d-bbc4-681138a6560a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:00.062493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ffebd-4de0-457d-bbc4-681138a6560a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-4d6ffebd-4de0-457d-bbc4-681138a6560a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:47:00.076916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:00.078383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:47:00.079673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:00.083000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 613/1239] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:46:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:00.083933 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2daeb4-7d98-4cbd-a5e6-1bd1045d0f05 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:00.185966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2daeb4-7d98-4cbd-a5e6-1bd1045d0f05 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:00.222428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5fbad-181a-4b63-8da3-775c10b28ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:00.222428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fbad-181a-4b63-8da3-775c10b28ae7 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:00.222732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fbad-181a-4b63-8da3-775c10b28ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:00.222980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fbad-181a-4b63-8da3-775c10b28ae7 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:00.223826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5fbad-181a-4b63-8da3-775c10b28ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:00.224196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5fbad-181a-4b63-8da3-775c10b28ae7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:00.226192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5fbad-181a-4b63-8da3-775c10b28ae7 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:00.246378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 627/1240] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 4 18:47:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:00.252583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ffebd-4de0-457d-bbc4-681138a6560a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:00.355758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ffebd-4de0-457d-bbc4-681138a6560a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:00.391929 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5162cb8-622d-435c-8434-3a2b09dc142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:00.392586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5162cb8-622d-435c-8434-3a2b09dc142a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:00.392870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5162cb8-622d-435c-8434-3a2b09dc142a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:00.393148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5162cb8-622d-435c-8434-3a2b09dc142a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:00.467487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5162cb8-622d-435c-8434-3a2b09dc142a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:00.469036 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5162cb8-622d-435c-8434-3a2b09dc142a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:00.570649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 614/1241] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:47:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:47:00.576722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5fbad-181a-4b63-8da3-775c10b28ae7 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:00.680712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5fbad-181a-4b63-8da3-775c10b28ae7 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:00.720815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937383-7383-49ec-ba57-154bad76ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:00.721724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937383-7383-49ec-ba57-154bad76ae45 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:00.722101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937383-7383-49ec-ba57-154bad76ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:00.722466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937383-7383-49ec-ba57-154bad76ae45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:00.734045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3937383-7383-49ec-ba57-154bad76ae45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:00.735828 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3937383-7383-49ec-ba57-154bad76ae45 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-f3937383-7383-49ec-ba57-154bad76ae45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:47:00.753601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:00.754866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:00.755975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:47:00.755975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:47:00.755975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:00.755975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:00.755975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 628/1242] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:00.760765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5162cb8-622d-435c-8434-3a2b09dc142a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:00.865392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5162cb8-622d-435c-8434-3a2b09dc142a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:00.901815 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c023d-381b-4c0b-8769-c0d2b87fc42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:00.902505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c023d-381b-4c0b-8769-c0d2b87fc42c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:00.902791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c023d-381b-4c0b-8769-c0d2b87fc42c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:00.903077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c023d-381b-4c0b-8769-c0d2b87fc42c None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:00.903811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c023d-381b-4c0b-8769-c0d2b87fc42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:00.904182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c023d-381b-4c0b-8769-c0d2b87fc42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:00.905668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c023d-381b-4c0b-8769-c0d2b87fc42c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:00.922597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 615/1243] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:00.923828 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937383-7383-49ec-ba57-154bad76ae45 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:01.024750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937383-7383-49ec-ba57-154bad76ae45 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:01.056798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb083c64-d9db-48ed-8ef7-6cfa528d23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:01.057660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb083c64-d9db-48ed-8ef7-6cfa528d23bd None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:01.057964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb083c64-d9db-48ed-8ef7-6cfa528d23bd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:01.058227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb083c64-d9db-48ed-8ef7-6cfa528d23bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:01.065400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb083c64-d9db-48ed-8ef7-6cfa528d23bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:01.066841 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb083c64-d9db-48ed-8ef7-6cfa528d23bd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-bb083c64-d9db-48ed-8ef7-6cfa528d23bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:47:01.080185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:01.081259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:01.087238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:47:01.087238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:47:01.087238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:47:01.087238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:47:01.087238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:47:01.087238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:47:01.087238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:47:01.087238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:01.087238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 629/1244] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:01.087760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c023d-381b-4c0b-8769-c0d2b87fc42c None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:01.194509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c023d-381b-4c0b-8769-c0d2b87fc42c None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:01.227740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d5128-0a27-4c3b-8294-1a7be9f380e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:01.228441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d5128-0a27-4c3b-8294-1a7be9f380e8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:01.228759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d5128-0a27-4c3b-8294-1a7be9f380e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:01.229034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d5128-0a27-4c3b-8294-1a7be9f380e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:01.229887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d5128-0a27-4c3b-8294-1a7be9f380e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:01.230197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d5128-0a27-4c3b-8294-1a7be9f380e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:01.231750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d5128-0a27-4c3b-8294-1a7be9f380e8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:01.244101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 616/1245] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:47:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:01.251112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb083c64-d9db-48ed-8ef7-6cfa528d23bd None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:01.355133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb083c64-d9db-48ed-8ef7-6cfa528d23bd None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:01.387769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a66abb-de5f-4662-9796-605bf866238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:01.388441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a66abb-de5f-4662-9796-605bf866238e None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:01.388744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a66abb-de5f-4662-9796-605bf866238e None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:01.389011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a66abb-de5f-4662-9796-605bf866238e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:01.389868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a66abb-de5f-4662-9796-605bf866238e None admin] RBAC: Adding query filter params (role.id=b2763aed3ee84a9a9c5186ecada8844f, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=f6eaf63f68734bdd938aa0ea7d0c4441) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:01.390175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a66abb-de5f-4662-9796-605bf866238e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:01.391936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a66abb-de5f-4662-9796-605bf866238e None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:01.398259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 630/1246] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:47:01 2022] GET /identity/v3/role_assignments?user.id=f6eaf63f68734bdd938aa0ea7d0c4441&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=b2763aed3ee84a9a9c5186ecada8844f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:04.030118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24263b0-7ab1-49ce-9b5b-9e7e3c9d1926 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:04.030764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24263b0-7ab1-49ce-9b5b-9e7e3c9d1926 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:04.030764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24263b0-7ab1-49ce-9b5b-9e7e3c9d1926 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:04.032271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 617/1247] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:47:04.037962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4b7c6-46c0-4fb8-bbff-37a580841c89 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:04.038427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4b7c6-46c0-4fb8-bbff-37a580841c89 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:04.038547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4b7c6-46c0-4fb8-bbff-37a580841c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:04.057534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-8fd4b7c6-46c0-4fb8-bbff-37a580841c89 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:47:04.058743 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8fd4b7c6-46c0-4fb8-bbff-37a580841c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:47:04.134584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 631/1248] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:47:04.159650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24263b0-7ab1-49ce-9b5b-9e7e3c9d1926 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:04.279496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24263b0-7ab1-49ce-9b5b-9e7e3c9d1926 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:04.321305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7377-34e2-4b31-8b2d-b3e79f9be5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:04.322336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7377-34e2-4b31-8b2d-b3e79f9be5c7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:04.322624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7377-34e2-4b31-8b2d-b3e79f9be5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:04.323060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7377-34e2-4b31-8b2d-b3e79f9be5c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:04.334461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab7377-34e2-4b31-8b2d-b3e79f9be5c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-65ab7377-34e2-4b31-8b2d-b3e79f9be5c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:47:04.342229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:04.343445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:04.344506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 618/1249] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:04.350086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4b7c6-46c0-4fb8-bbff-37a580841c89 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:04.450286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4b7c6-46c0-4fb8-bbff-37a580841c89 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:04.487860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a6986-e21c-430b-af8f-acd4180d86a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:04.488536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a6986-e21c-430b-af8f-acd4180d86a3 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:04.488845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a6986-e21c-430b-af8f-acd4180d86a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:04.489108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a6986-e21c-430b-af8f-acd4180d86a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:04.489956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a6986-e21c-430b-af8f-acd4180d86a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:04.490288 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a6986-e21c-430b-af8f-acd4180d86a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:04.491717 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a6986-e21c-430b-af8f-acd4180d86a3 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:04.501109 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 632/1250] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:04.507571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7377-34e2-4b31-8b2d-b3e79f9be5c7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:04.625062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7377-34e2-4b31-8b2d-b3e79f9be5c7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:04.661085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7be77a-2d0d-4a7e-b172-c46d662697d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:04.661907 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7be77a-2d0d-4a7e-b172-c46d662697d7 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:04.662201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7be77a-2d0d-4a7e-b172-c46d662697d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:04.662474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7be77a-2d0d-4a7e-b172-c46d662697d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:04.673097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7be77a-2d0d-4a7e-b172-c46d662697d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:04.674571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7be77a-2d0d-4a7e-b172-c46d662697d7 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-5a7be77a-2d0d-4a7e-b172-c46d662697d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:47:04.692061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:04.693206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:04.694337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:47:04.694337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:47:04.694337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:04.694337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:04.694337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 619/1251] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:47:04.699273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a6986-e21c-430b-af8f-acd4180d86a3 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:04.810020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a6986-e21c-430b-af8f-acd4180d86a3 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:04.856552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061733d-537b-4df3-89da-deeb71b677d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:04.857337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061733d-537b-4df3-89da-deeb71b677d0 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:04.857679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061733d-537b-4df3-89da-deeb71b677d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:04.857969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061733d-537b-4df3-89da-deeb71b677d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:04.858687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061733d-537b-4df3-89da-deeb71b677d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:04.858995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061733d-537b-4df3-89da-deeb71b677d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:04.860680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061733d-537b-4df3-89da-deeb71b677d0 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:04.873027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 633/1252] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:47:04.878755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7be77a-2d0d-4a7e-b172-c46d662697d7 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:04.984878 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7be77a-2d0d-4a7e-b172-c46d662697d7 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:05.019969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d406659-9d39-4b5d-ad1a-beb58bd1f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:05.020900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d406659-9d39-4b5d-ad1a-beb58bd1f3d4 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:05.021230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d406659-9d39-4b5d-ad1a-beb58bd1f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:05.021564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d406659-9d39-4b5d-ad1a-beb58bd1f3d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:05.029083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d406659-9d39-4b5d-ad1a-beb58bd1f3d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:05.030556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d406659-9d39-4b5d-ad1a-beb58bd1f3d4 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8d406659-9d39-4b5d-ad1a-beb58bd1f3d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:47:05.045792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:05.046949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:05.048124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 620/1253] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:05.052992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061733d-537b-4df3-89da-deeb71b677d0 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:05.163476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061733d-537b-4df3-89da-deeb71b677d0 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:05.198924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a74762-e353-43e8-b225-546aed154d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:05.199625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a74762-e353-43e8-b225-546aed154d42 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:05.199903 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a74762-e353-43e8-b225-546aed154d42 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:05.200173 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a74762-e353-43e8-b225-546aed154d42 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:05.201044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a74762-e353-43e8-b225-546aed154d42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:05.201368 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a74762-e353-43e8-b225-546aed154d42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:05.202804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a74762-e353-43e8-b225-546aed154d42 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:05.226807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 634/1254] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 4 18:47:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:05.228252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d406659-9d39-4b5d-ad1a-beb58bd1f3d4 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:05.338194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d406659-9d39-4b5d-ad1a-beb58bd1f3d4 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:05.375057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622dc5-df49-4281-bf8c-2addbf664f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:05.375822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622dc5-df49-4281-bf8c-2addbf664f0b None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:05.376100 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622dc5-df49-4281-bf8c-2addbf664f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:05.376411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622dc5-df49-4281-bf8c-2addbf664f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:05.447534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3622dc5-df49-4281-bf8c-2addbf664f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:05.449150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3622dc5-df49-4281-bf8c-2addbf664f0b None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:05.563088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 621/1255] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:47:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 18:47:05.564405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a74762-e353-43e8-b225-546aed154d42 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:05.671947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a74762-e353-43e8-b225-546aed154d42 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:05.708817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dd40e-1d88-4f13-ad65-eb9fc1c253cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:05.709549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd40e-1d88-4f13-ad65-eb9fc1c253cd None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:05.709829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd40e-1d88-4f13-ad65-eb9fc1c253cd None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:05.710101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd40e-1d88-4f13-ad65-eb9fc1c253cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:05.721500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dd40e-1d88-4f13-ad65-eb9fc1c253cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:05.722982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dd40e-1d88-4f13-ad65-eb9fc1c253cd None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-313dd40e-1d88-4f13-ad65-eb9fc1c253cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:47:05.741884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:05.742975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:05.743993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:47:05.743993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:47:05.743993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:05.743993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:05.743993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 635/1256] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:05.749684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622dc5-df49-4281-bf8c-2addbf664f0b None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:05.855544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622dc5-df49-4281-bf8c-2addbf664f0b None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:05.894044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5bb6-7cf5-4987-99ae-da7cd961b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:05.894720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5bb6-7cf5-4987-99ae-da7cd961b582 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:05.894996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5bb6-7cf5-4987-99ae-da7cd961b582 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:05.895268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5bb6-7cf5-4987-99ae-da7cd961b582 None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:05.896011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b5bb6-7cf5-4987-99ae-da7cd961b582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:05.896321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b5bb6-7cf5-4987-99ae-da7cd961b582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:05.897743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b5bb6-7cf5-4987-99ae-da7cd961b582 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:05.914947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 622/1257] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:05.916239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dd40e-1d88-4f13-ad65-eb9fc1c253cd None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:06.014154 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dd40e-1d88-4f13-ad65-eb9fc1c253cd None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:06.046924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04535d13-b6b4-44c3-ad17-4a4ed9522831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:06.047727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04535d13-b6b4-44c3-ad17-4a4ed9522831 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:06.048039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04535d13-b6b4-44c3-ad17-4a4ed9522831 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:06.048307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04535d13-b6b4-44c3-ad17-4a4ed9522831 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:06.055012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04535d13-b6b4-44c3-ad17-4a4ed9522831 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:06.056437 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04535d13-b6b4-44c3-ad17-4a4ed9522831 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-04535d13-b6b4-44c3-ad17-4a4ed9522831 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:47:06.069879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:06.071053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:06.072188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:47:06.072188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:47:06.072188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:47:06.072188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:47:06.072188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:47:06.072188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:47:06.072188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:47:06.072188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:06.072188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 636/1258] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:06.077043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5bb6-7cf5-4987-99ae-da7cd961b582 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:06.173078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5bb6-7cf5-4987-99ae-da7cd961b582 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:06.205660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ce716-e5fd-4a6f-924a-0406e7874a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:06.206479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce716-e5fd-4a6f-924a-0406e7874a38 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:06.206745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce716-e5fd-4a6f-924a-0406e7874a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:06.207016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce716-e5fd-4a6f-924a-0406e7874a38 None admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:06.207812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ce716-e5fd-4a6f-924a-0406e7874a38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:06.208116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ce716-e5fd-4a6f-924a-0406e7874a38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:06.209555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ce716-e5fd-4a6f-924a-0406e7874a38 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:06.221318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 623/1259] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:47:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:06.228290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04535d13-b6b4-44c3-ad17-4a4ed9522831 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:06.333733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04535d13-b6b4-44c3-ad17-4a4ed9522831 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:06.368449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398b932-505d-4358-a239-d154707b6f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:06.369080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398b932-505d-4358-a239-d154707b6f7c None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:06.369382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398b932-505d-4358-a239-d154707b6f7c None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:06.369654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398b932-505d-4358-a239-d154707b6f7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:06.370484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398b932-505d-4358-a239-d154707b6f7c None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=f6eaf63f68734bdd938aa0ea7d0c4441) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:06.370792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398b932-505d-4358-a239-d154707b6f7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:06.372532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398b932-505d-4358-a239-d154707b6f7c None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:06.377999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 637/1260] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:47:06 2022] GET /identity/v3/role_assignments?user.id=f6eaf63f68734bdd938aa0ea7d0c4441&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:08.557180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046e070-4d61-4c74-b4ba-e6bd9d9fadba None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:08.557766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046e070-4d61-4c74-b4ba-e6bd9d9fadba None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:08.557766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046e070-4d61-4c74-b4ba-e6bd9d9fadba None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:08.559130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 624/1261] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:47:08.565619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c299342-6553-4582-905b-52b58ff4300e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:08.566326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c299342-6553-4582-905b-52b58ff4300e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:08.566516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c299342-6553-4582-905b-52b58ff4300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:08.587503 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6c299342-6553-4582-905b-52b58ff4300e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:47:08.588697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6c299342-6553-4582-905b-52b58ff4300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:47:08.656761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 638/1262] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:47:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:47:08.684173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046e070-4d61-4c74-b4ba-e6bd9d9fadba None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:08.794877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046e070-4d61-4c74-b4ba-e6bd9d9fadba None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:08.836676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1cd45-09ac-44b7-98ba-ba6873bdd858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:08.837737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1cd45-09ac-44b7-98ba-ba6873bdd858 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:08.838030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1cd45-09ac-44b7-98ba-ba6873bdd858 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:08.838372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1cd45-09ac-44b7-98ba-ba6873bdd858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:08.850992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1cd45-09ac-44b7-98ba-ba6873bdd858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-63c1cd45-09ac-44b7-98ba-ba6873bdd858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:47:08.860207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:08.861240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:08.862140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 625/1263] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:47:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:08.870570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c299342-6553-4582-905b-52b58ff4300e None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:08.967710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c299342-6553-4582-905b-52b58ff4300e None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:09.001702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f661b8-7650-46d9-8ba6-7011bd4d8ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:09.002356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f661b8-7650-46d9-8ba6-7011bd4d8ea6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:09.002640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f661b8-7650-46d9-8ba6-7011bd4d8ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:09.002914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f661b8-7650-46d9-8ba6-7011bd4d8ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:09.003665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f661b8-7650-46d9-8ba6-7011bd4d8ea6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:09.003975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f661b8-7650-46d9-8ba6-7011bd4d8ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:09.005334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f661b8-7650-46d9-8ba6-7011bd4d8ea6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:09.013260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 639/1264] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:47:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:09.019589 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1cd45-09ac-44b7-98ba-ba6873bdd858 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:09.124482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1cd45-09ac-44b7-98ba-ba6873bdd858 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:09.160105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae02bc-1501-4330-bcba-76d7cb39f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:09.160894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae02bc-1501-4330-bcba-76d7cb39f711 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:09.161175 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae02bc-1501-4330-bcba-76d7cb39f711 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:09.161484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae02bc-1501-4330-bcba-76d7cb39f711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:09.172129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae02bc-1501-4330-bcba-76d7cb39f711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:09.173596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae02bc-1501-4330-bcba-76d7cb39f711 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-e7ae02bc-1501-4330-bcba-76d7cb39f711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:47:09.190985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:09.192088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:09.193512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:47:09.193512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:47:09.193512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:09.193512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:09.193512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 626/1265] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:09.200930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f661b8-7650-46d9-8ba6-7011bd4d8ea6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:09.301326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f661b8-7650-46d9-8ba6-7011bd4d8ea6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:09.334658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d13ac6-42e6-45fe-b688-ff18b34c2429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:09.335295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d13ac6-42e6-45fe-b688-ff18b34c2429 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:09.335570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d13ac6-42e6-45fe-b688-ff18b34c2429 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:09.335838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d13ac6-42e6-45fe-b688-ff18b34c2429 None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:09.336545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d13ac6-42e6-45fe-b688-ff18b34c2429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:09.336850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d13ac6-42e6-45fe-b688-ff18b34c2429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:09.338215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d13ac6-42e6-45fe-b688-ff18b34c2429 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:09.349558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 640/1266] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:09.358241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae02bc-1501-4330-bcba-76d7cb39f711 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:09.484003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae02bc-1501-4330-bcba-76d7cb39f711 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:09.521525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5621cb-7c1a-41fe-85be-cb16867de330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:09.522324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5621cb-7c1a-41fe-85be-cb16867de330 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:09.522599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5621cb-7c1a-41fe-85be-cb16867de330 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:09.522867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5621cb-7c1a-41fe-85be-cb16867de330 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:09.530498 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5621cb-7c1a-41fe-85be-cb16867de330 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:09.531939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5621cb-7c1a-41fe-85be-cb16867de330 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-9f5621cb-7c1a-41fe-85be-cb16867de330 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:47:09.547439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:09.548385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:09.549568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 627/1267] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:09.554765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d13ac6-42e6-45fe-b688-ff18b34c2429 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:09.654166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d13ac6-42e6-45fe-b688-ff18b34c2429 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:09.687421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efc446-b906-48fe-b8b5-215d7b261b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:09.688626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc446-b906-48fe-b8b5-215d7b261b21 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:09.689047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc446-b906-48fe-b8b5-215d7b261b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:09.689501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc446-b906-48fe-b8b5-215d7b261b21 None admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:09.690856 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efc446-b906-48fe-b8b5-215d7b261b21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:09.691340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efc446-b906-48fe-b8b5-215d7b261b21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:09.693663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efc446-b906-48fe-b8b5-215d7b261b21 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:09.719398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 641/1268] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 4 18:47:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:09.725204 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5621cb-7c1a-41fe-85be-cb16867de330 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:09.835401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5621cb-7c1a-41fe-85be-cb16867de330 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:09.873449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850cc4d-91b4-43f7-81a1-b875fa601bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:09.874268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850cc4d-91b4-43f7-81a1-b875fa601bb6 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:09.874545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850cc4d-91b4-43f7-81a1-b875fa601bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:09.874813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850cc4d-91b4-43f7-81a1-b875fa601bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:09.885229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850cc4d-91b4-43f7-81a1-b875fa601bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:09.886717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850cc4d-91b4-43f7-81a1-b875fa601bb6 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-c850cc4d-91b4-43f7-81a1-b875fa601bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:47:09.903331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:09.904302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:09.905571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:47:09.905571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:47:09.905571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:09.905571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:09.905571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 628/1269] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:09.910517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efc446-b906-48fe-b8b5-215d7b261b21 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:10.006649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efc446-b906-48fe-b8b5-215d7b261b21 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:10.039293 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c749a-7ec5-4101-b3f0-a78a71d23e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:10.039932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c749a-7ec5-4101-b3f0-a78a71d23e4f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:10.040205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c749a-7ec5-4101-b3f0-a78a71d23e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:10.040472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c749a-7ec5-4101-b3f0-a78a71d23e4f None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:10.041192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c749a-7ec5-4101-b3f0-a78a71d23e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:10.041515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c749a-7ec5-4101-b3f0-a78a71d23e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:10.042852 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c749a-7ec5-4101-b3f0-a78a71d23e4f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:10.054168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 642/1270] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:10.060316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850cc4d-91b4-43f7-81a1-b875fa601bb6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:10.165782 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850cc4d-91b4-43f7-81a1-b875fa601bb6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:10.199153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c50d10-9fe3-4d0c-ae87-7d9d84889026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:10.199926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c50d10-9fe3-4d0c-ae87-7d9d84889026 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:10.200201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c50d10-9fe3-4d0c-ae87-7d9d84889026 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:10.200474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c50d10-9fe3-4d0c-ae87-7d9d84889026 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:10.207381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c50d10-9fe3-4d0c-ae87-7d9d84889026 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:10.208826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c50d10-9fe3-4d0c-ae87-7d9d84889026 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-d2c50d10-9fe3-4d0c-ae87-7d9d84889026 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:47:10.222993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:10.224010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:10.225250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:47:10.225250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:47:10.225250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:47:10.225250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:47:10.225250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:47:10.225250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:47:10.225250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:47:10.225250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:10.225250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 629/1271] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:47:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:10.229975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c749a-7ec5-4101-b3f0-a78a71d23e4f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:10.329060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c749a-7ec5-4101-b3f0-a78a71d23e4f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:10.373317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9feb0-1c7e-44ef-bf59-451a46c74ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:10.374406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9feb0-1c7e-44ef-bf59-451a46c74ddb None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:10.374887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9feb0-1c7e-44ef-bf59-451a46c74ddb None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:10.375387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9feb0-1c7e-44ef-bf59-451a46c74ddb None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:10.376831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9feb0-1c7e-44ef-bf59-451a46c74ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:10.377362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9feb0-1c7e-44ef-bf59-451a46c74ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:10.379682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9feb0-1c7e-44ef-bf59-451a46c74ddb None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:10.398041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 643/1272] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:47:10.406829 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c50d10-9fe3-4d0c-ae87-7d9d84889026 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:10.515352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c50d10-9fe3-4d0c-ae87-7d9d84889026 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:10.550136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4bf11-72be-498e-a873-359bfaf5e9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:10.551008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4bf11-72be-498e-a873-359bfaf5e9da None admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:10.551285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4bf11-72be-498e-a873-359bfaf5e9da None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:10.551553 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4bf11-72be-498e-a873-359bfaf5e9da None admin] PATH_INFO: `/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/f6eaf63f68734bdd938aa0ea7d0c4441/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:10.553762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4bf11-72be-498e-a873-359bfaf5e9da None admin] RBAC: Authorizing `identity:create_grant(project_id=5b43ce1e064744e0b92d841d7b2bae65, user_id=f6eaf63f68734bdd938aa0ea7d0c4441, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:10.555185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4bf11-72be-498e-a873-359bfaf5e9da None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:10.571317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 630/1273] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 4 18:47:10 2022] PUT /identity/v3/projects/5b43ce1e064744e0b92d841d7b2bae65/users/f6eaf63f68734bdd938aa0ea7d0c4441/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:47:12.791383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ddc6-ea55-4039-824f-cf022f12e2f3 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:12.792192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ddc6-ea55-4039-824f-cf022f12e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:12.792381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ddc6-ea55-4039-824f-cf022f12e2f3 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:12.794367 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 644/1274] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:47:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:47:12.802078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fb15f-39c1-4e8b-b91e-4acd9ad874fa None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:12.802702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fb15f-39c1-4e8b-b91e-4acd9ad874fa None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:12.802824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fb15f-39c1-4e8b-b91e-4acd9ad874fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:12.826375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-138fb15f-39c1-4e8b-b91e-4acd9ad874fa None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:47:12.828068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-138fb15f-39c1-4e8b-b91e-4acd9ad874fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:47:12.898109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 631/1275] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:47:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:47:12.922265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ddc6-ea55-4039-824f-cf022f12e2f3 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:13.030368 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ddc6-ea55-4039-824f-cf022f12e2f3 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:13.063604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db705821-1ccd-4ae2-a6b9-f1e93c1c1c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:13.064303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db705821-1ccd-4ae2-a6b9-f1e93c1c1c6d None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:13.064581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db705821-1ccd-4ae2-a6b9-f1e93c1c1c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:13.064842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db705821-1ccd-4ae2-a6b9-f1e93c1c1c6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:13.075132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db705821-1ccd-4ae2-a6b9-f1e93c1c1c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-db705821-1ccd-4ae2-a6b9-f1e93c1c1c6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 18:47:13.082600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:13.083693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:13.084773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 645/1276] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 4 18:47:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:13.091988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fb15f-39c1-4e8b-b91e-4acd9ad874fa None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:13.196969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fb15f-39c1-4e8b-b91e-4acd9ad874fa None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:13.230061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7362ee-48fe-4424-b5f5-95f1680f15e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:13.230710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7362ee-48fe-4424-b5f5-95f1680f15e1 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:13.230989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7362ee-48fe-4424-b5f5-95f1680f15e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:13.231262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7362ee-48fe-4424-b5f5-95f1680f15e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:13.232006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7362ee-48fe-4424-b5f5-95f1680f15e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:13.232313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7362ee-48fe-4424-b5f5-95f1680f15e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:13.233744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7362ee-48fe-4424-b5f5-95f1680f15e1 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:13.241964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 632/1277] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 4 18:47:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:13.251269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db705821-1ccd-4ae2-a6b9-f1e93c1c1c6d None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:13.375633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db705821-1ccd-4ae2-a6b9-f1e93c1c1c6d None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:13.417155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c869233-e378-4276-95df-d13f4bfd778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:13.417961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869233-e378-4276-95df-d13f4bfd778a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:13.418243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869233-e378-4276-95df-d13f4bfd778a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:13.418517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869233-e378-4276-95df-d13f4bfd778a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:13.429126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c869233-e378-4276-95df-d13f4bfd778a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:13.430622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c869233-e378-4276-95df-d13f4bfd778a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-6c869233-e378-4276-95df-d13f4bfd778a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:47:13.447593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:13.448609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:13.449733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:47:13.449733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:47:13.449733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:13.449733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:13.449733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 646/1278] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:13.455272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7362ee-48fe-4424-b5f5-95f1680f15e1 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:13.554347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7362ee-48fe-4424-b5f5-95f1680f15e1 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:13.586229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362631fe-545c-4b5d-b535-3a992498daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:13.586873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362631fe-545c-4b5d-b535-3a992498daee None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:13.587148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362631fe-545c-4b5d-b535-3a992498daee None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:13.587416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362631fe-545c-4b5d-b535-3a992498daee None admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:13.588129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362631fe-545c-4b5d-b535-3a992498daee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:13.588426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362631fe-545c-4b5d-b535-3a992498daee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:13.589812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362631fe-545c-4b5d-b535-3a992498daee None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:13.600434 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 633/1279] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:13.606454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c869233-e378-4276-95df-d13f4bfd778a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:13.707589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c869233-e378-4276-95df-d13f4bfd778a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:13.740795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec5967-9d6a-47d4-b35f-c0bc2d335fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:13.741603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec5967-9d6a-47d4-b35f-c0bc2d335fe8 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:13.741883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec5967-9d6a-47d4-b35f-c0bc2d335fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:13.742151 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec5967-9d6a-47d4-b35f-c0bc2d335fe8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:13.750179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec5967-9d6a-47d4-b35f-c0bc2d335fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:13.751621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec5967-9d6a-47d4-b35f-c0bc2d335fe8 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-36ec5967-9d6a-47d4-b35f-c0bc2d335fe8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 18:47:13.765882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:13.766969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:13.769021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 647/1280] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 18:47:13.775798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362631fe-545c-4b5d-b535-3a992498daee None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:13.877777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362631fe-545c-4b5d-b535-3a992498daee None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:13.911053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbe295-c1b7-45c5-811b-e084ccc69d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:13.911708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbe295-c1b7-45c5-811b-e084ccc69d67 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:13.911988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbe295-c1b7-45c5-811b-e084ccc69d67 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:13.912263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbe295-c1b7-45c5-811b-e084ccc69d67 None admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:13.913103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbe295-c1b7-45c5-811b-e084ccc69d67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:13.913441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbe295-c1b7-45c5-811b-e084ccc69d67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:13.914865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbe295-c1b7-45c5-811b-e084ccc69d67 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:13.931618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 634/1281] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 4 18:47:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:13.939966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec5967-9d6a-47d4-b35f-c0bc2d335fe8 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:14.054383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec5967-9d6a-47d4-b35f-c0bc2d335fe8 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:14.088509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0659-5a3e-46e1-9548-c8d9bb65fe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:14.089137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0659-5a3e-46e1-9548-c8d9bb65fe2a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:14.089450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0659-5a3e-46e1-9548-c8d9bb65fe2a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:14.089721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0659-5a3e-46e1-9548-c8d9bb65fe2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:14.162591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0659-5a3e-46e1-9548-c8d9bb65fe2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:14.164010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0659-5a3e-46e1-9548-c8d9bb65fe2a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:14.257491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 648/1282] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 4 18:47:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 18:47:14.266682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbe295-c1b7-45c5-811b-e084ccc69d67 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:14.368495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbe295-c1b7-45c5-811b-e084ccc69d67 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:14.405695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498c0d0-5079-4367-bdf4-dc58a4ba98f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:14.406473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498c0d0-5079-4367-bdf4-dc58a4ba98f6 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:14.406750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498c0d0-5079-4367-bdf4-dc58a4ba98f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:14.407023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498c0d0-5079-4367-bdf4-dc58a4ba98f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:14.418085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498c0d0-5079-4367-bdf4-dc58a4ba98f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:14.419518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498c0d0-5079-4367-bdf4-dc58a4ba98f6 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-5498c0d0-5079-4367-bdf4-dc58a4ba98f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 18:47:14.438566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:14.439532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:14.440452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 18:47:14.440452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 18:47:14.440452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 18:47:14.440452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:14.440452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 635/1283] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:14.445481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0659-5a3e-46e1-9548-c8d9bb65fe2a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:14.546168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0659-5a3e-46e1-9548-c8d9bb65fe2a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:14.580124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d1576-ef78-4404-9289-32b29787303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:14.580782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d1576-ef78-4404-9289-32b29787303a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:14.581139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d1576-ef78-4404-9289-32b29787303a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:14.581446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d1576-ef78-4404-9289-32b29787303a None admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:14.582156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d1576-ef78-4404-9289-32b29787303a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:14.582458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d1576-ef78-4404-9289-32b29787303a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:14.583800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d1576-ef78-4404-9289-32b29787303a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:14.594704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 649/1284] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 4 18:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:14.603652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498c0d0-5079-4367-bdf4-dc58a4ba98f6 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:14.701370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498c0d0-5079-4367-bdf4-dc58a4ba98f6 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:14.738872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633d5d-17e7-4d35-afe9-17d2ef86dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:14.739997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633d5d-17e7-4d35-afe9-17d2ef86dd3a None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:14.740363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633d5d-17e7-4d35-afe9-17d2ef86dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:14.740708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633d5d-17e7-4d35-afe9-17d2ef86dd3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:14.752291 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c633d5d-17e7-4d35-afe9-17d2ef86dd3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:14.754620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c633d5d-17e7-4d35-afe9-17d2ef86dd3a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application [None req-8c633d5d-17e7-4d35-afe9-17d2ef86dd3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 18:47:14.775103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application with Lock( May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:14.776104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:14.777109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 18:47:14.777109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 18:47:14.777109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 18:47:14.777109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 18:47:14.777109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 18:47:14.777109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 18:47:14.777109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 18:47:14.777109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: ERROR keystone.server.flask.application May 04 18:47:14.777109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 636/1285] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 4 18:47:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:14.783059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d1576-ef78-4404-9289-32b29787303a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:14.880437 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d1576-ef78-4404-9289-32b29787303a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:14.913704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791dc36-b15d-4755-be70-8cc9c6368ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:14.914338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791dc36-b15d-4755-be70-8cc9c6368ee5 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:14.914616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791dc36-b15d-4755-be70-8cc9c6368ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:14.914884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791dc36-b15d-4755-be70-8cc9c6368ee5 None admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:14.915661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791dc36-b15d-4755-be70-8cc9c6368ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:14.915960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791dc36-b15d-4755-be70-8cc9c6368ee5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:14.917388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791dc36-b15d-4755-be70-8cc9c6368ee5 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:14.928963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 650/1286] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 4 18:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:14.935224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633d5d-17e7-4d35-afe9-17d2ef86dd3a None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:15.064719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633d5d-17e7-4d35-afe9-17d2ef86dd3a None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:15.098028 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca5184-5af0-4acc-bd1d-ab95996c8949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:15.098658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca5184-5af0-4acc-bd1d-ab95996c8949 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:15.098936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca5184-5af0-4acc-bd1d-ab95996c8949 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:15.099202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca5184-5af0-4acc-bd1d-ab95996c8949 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:15.100028 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca5184-5af0-4acc-bd1d-ab95996c8949 None admin] RBAC: Adding query filter params (role.id=91a83250a647489fb1e2f0465776fbe3, scope.project.id=5b43ce1e064744e0b92d841d7b2bae65, user.id=f6eaf63f68734bdd938aa0ea7d0c4441) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:15.100329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca5184-5af0-4acc-bd1d-ab95996c8949 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:15.101769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca5184-5af0-4acc-bd1d-ab95996c8949 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:15.107568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 637/1287] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 4 18:47:14 2022] GET /identity/v3/role_assignments?user.id=f6eaf63f68734bdd938aa0ea7d0c4441&scope.project.id=5b43ce1e064744e0b92d841d7b2bae65&role.id=91a83250a647489fb1e2f0465776fbe3 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:17.304028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553742-c120-420a-917d-d3a7c4dd215d None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:17.304634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553742-c120-420a-917d-d3a7c4dd215d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:17.304634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553742-c120-420a-917d-d3a7c4dd215d None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:17.305985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 651/1288] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:47:17.312259 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ddac7-d5f3-4bdf-849e-ca8c519411c5 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:17.312930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ddac7-d5f3-4bdf-849e-ca8c519411c5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:17.313133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ddac7-d5f3-4bdf-849e-ca8c519411c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:17.341785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-6f5ddac7-d5f3-4bdf-849e-ca8c519411c5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:47:17.343328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6f5ddac7-d5f3-4bdf-849e-ca8c519411c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:47:17.414426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 638/1289] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:47:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:47:17.444888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553742-c120-420a-917d-d3a7c4dd215d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:17.555217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553742-c120-420a-917d-d3a7c4dd215d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:17.588529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba93314-8b77-4bc2-88ca-70216c22959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:17.589330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba93314-8b77-4bc2-88ca-70216c22959a None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:17.589617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba93314-8b77-4bc2-88ca-70216c22959a None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:17.589888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba93314-8b77-4bc2-88ca-70216c22959a None admin] PATH_INFO: `/v3/services/placement` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:17.590584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba93314-8b77-4bc2-88ca-70216c22959a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:17.591979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba93314-8b77-4bc2-88ca-70216c22959a None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-1ba93314-8b77-4bc2-88ca-70216c22959a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:17.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:17.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:17.607423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 652/1290] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:47:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:17.611325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ddac7-d5f3-4bdf-849e-ca8c519411c5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:17.709523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ddac7-d5f3-4bdf-849e-ca8c519411c5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:17.746015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a02b-fa33-4ef4-accc-a92126098635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:17.746980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a02b-fa33-4ef4-accc-a92126098635 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:17.747262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a02b-fa33-4ef4-accc-a92126098635 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:17.747536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a02b-fa33-4ef4-accc-a92126098635 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:17.748237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815a02b-fa33-4ef4-accc-a92126098635 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:17.748603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815a02b-fa33-4ef4-accc-a92126098635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:17.749979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815a02b-fa33-4ef4-accc-a92126098635 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:17.754684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 639/1291] 10.222.0.35 () {56 vars in 1116 bytes} [Wed May 4 18:47:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:17.760545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba93314-8b77-4bc2-88ca-70216c22959a None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:17.859784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba93314-8b77-4bc2-88ca-70216c22959a None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:17.893116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f624b-3a04-4e7e-980a-3a72dbb2db21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:17.893800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f624b-3a04-4e7e-980a-3a72dbb2db21 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:17.894083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f624b-3a04-4e7e-980a-3a72dbb2db21 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:17.894350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f624b-3a04-4e7e-980a-3a72dbb2db21 None admin] PATH_INFO: `/v3/services` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:17.895055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f624b-3a04-4e7e-980a-3a72dbb2db21 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:17.895356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f624b-3a04-4e7e-980a-3a72dbb2db21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:17.896721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f624b-3a04-4e7e-980a-3a72dbb2db21 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:17.901147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 653/1292] 10.222.0.35 () {56 vars in 1116 bytes} [Wed May 4 18:47:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:20.099672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1db5-ec0b-4c0e-a5a8-6f1c7fa86530 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:20.100267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1db5-ec0b-4c0e-a5a8-6f1c7fa86530 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:20.100267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1db5-ec0b-4c0e-a5a8-6f1c7fa86530 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:20.101580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 640/1293] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:47:20.107861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b935bd-85ae-478f-b6af-fe127e2bad93 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:20.108296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b935bd-85ae-478f-b6af-fe127e2bad93 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:20.108424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b935bd-85ae-478f-b6af-fe127e2bad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:20.127159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d6b935bd-85ae-478f-b6af-fe127e2bad93 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:47:20.128355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d6b935bd-85ae-478f-b6af-fe127e2bad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:47:20.196574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 654/1294] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:47:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:47:20.227771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1db5-ec0b-4c0e-a5a8-6f1c7fa86530 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:20.348088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1db5-ec0b-4c0e-a5a8-6f1c7fa86530 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:20.381901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24238d-1b60-4059-83d4-e2324ebace7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:20.382452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24238d-1b60-4059-83d4-e2324ebace7a None admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:20.382761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24238d-1b60-4059-83d4-e2324ebace7a None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:20.383005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24238d-1b60-4059-83d4-e2324ebace7a None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:20.384076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24238d-1b60-4059-83d4-e2324ebace7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:20.385771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24238d-1b60-4059-83d4-e2324ebace7a None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:20.401267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 641/1295] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 4 18:47:20 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:47:22.632682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabce70-3172-4198-b7f4-313c49a72bad None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:22.633247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabce70-3172-4198-b7f4-313c49a72bad None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:22.633247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabce70-3172-4198-b7f4-313c49a72bad None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:22.635391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 655/1296] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:47:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:47:22.644060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5cf6-a993-4589-a536-859398d478ff None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:22.644833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5cf6-a993-4589-a536-859398d478ff None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:22.644986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5cf6-a993-4589-a536-859398d478ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:22.667327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-721b5cf6-a993-4589-a536-859398d478ff None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:47:22.668531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-721b5cf6-a993-4589-a536-859398d478ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:47:22.747196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 642/1297] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:47:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:47:22.782430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabce70-3172-4198-b7f4-313c49a72bad None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:22.901619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabce70-3172-4198-b7f4-313c49a72bad None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:22.936229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283302a2-4026-45eb-aac7-f1f11493b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:22.937019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283302a2-4026-45eb-aac7-f1f11493b74f None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:22.937328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283302a2-4026-45eb-aac7-f1f11493b74f None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:22.937604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283302a2-4026-45eb-aac7-f1f11493b74f None admin] PATH_INFO: `/v3/services/placement` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:22.938243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283302a2-4026-45eb-aac7-f1f11493b74f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:22.939618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283302a2-4026-45eb-aac7-f1f11493b74f None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-283302a2-4026-45eb-aac7-f1f11493b74f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:22.952105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:22.953242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:22.954306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 656/1298] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:47:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:22.961318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b5cf6-a993-4589-a536-859398d478ff None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:23.067367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b5cf6-a993-4589-a536-859398d478ff None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:23.101322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7bb0-dfe1-4277-b7e8-9dfad73f18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:23.101993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7bb0-dfe1-4277-b7e8-9dfad73f18b8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:23.102276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7bb0-dfe1-4277-b7e8-9dfad73f18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:23.102566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7bb0-dfe1-4277-b7e8-9dfad73f18b8 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:23.103294 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b7bb0-dfe1-4277-b7e8-9dfad73f18b8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:23.103601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b7bb0-dfe1-4277-b7e8-9dfad73f18b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:23.104985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b7bb0-dfe1-4277-b7e8-9dfad73f18b8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:23.110531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 643/1299] 10.222.0.35 () {56 vars in 1116 bytes} [Wed May 4 18:47:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:47:23.116826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283302a2-4026-45eb-aac7-f1f11493b74f None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:23.224944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283302a2-4026-45eb-aac7-f1f11493b74f None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:23.259061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b6913-f35c-4974-8fe7-74a9cbae2e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:23.259712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b6913-f35c-4974-8fe7-74a9cbae2e88 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:23.259991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b6913-f35c-4974-8fe7-74a9cbae2e88 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:23.260266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b6913-f35c-4974-8fe7-74a9cbae2e88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:23.261054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b6913-f35c-4974-8fe7-74a9cbae2e88 None admin] RBAC: Adding query filter params (interface=public, service_id=ddd891b1323c43a183264291de3e8cae, region_id=RegionOne) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:23.261475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b6913-f35c-4974-8fe7-74a9cbae2e88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:23.262848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b6913-f35c-4974-8fe7-74a9cbae2e88 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:23.268355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 657/1300] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 4 18:47:23 2022] GET /identity/v3/endpoints?service_id=ddd891b1323c43a183264291de3e8cae&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:23.274333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7bb0-dfe1-4277-b7e8-9dfad73f18b8 None admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:23.382226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7bb0-dfe1-4277-b7e8-9dfad73f18b8 None admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:23.417250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745eb0-2eeb-4af8-8d9d-b566a54162f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:23.417949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745eb0-2eeb-4af8-8d9d-b566a54162f8 None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:23.418226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745eb0-2eeb-4af8-8d9d-b566a54162f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:23.418494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745eb0-2eeb-4af8-8d9d-b566a54162f8 None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:23.419174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745eb0-2eeb-4af8-8d9d-b566a54162f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:23.420564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745eb0-2eeb-4af8-8d9d-b566a54162f8 None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:23.428254 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 644/1301] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 4 18:47:23 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:47:25.620955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d992-b92c-4ab2-b2b2-daef5e90fa1c None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:25.622198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d992-b92c-4ab2-b2b2-daef5e90fa1c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:25.622198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d992-b92c-4ab2-b2b2-daef5e90fa1c None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:25.624358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 658/1302] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:47:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:47:25.632960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f0a47-5d8f-4bf8-bc0f-d69af33e06fd None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:25.633396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f0a47-5d8f-4bf8-bc0f-d69af33e06fd None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:25.633594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f0a47-5d8f-4bf8-bc0f-d69af33e06fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:25.653422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ed2f0a47-5d8f-4bf8-bc0f-d69af33e06fd None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:47:25.654607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ed2f0a47-5d8f-4bf8-bc0f-d69af33e06fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:47:25.720837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 645/1303] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:47:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 18:47:25.743957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873d992-b92c-4ab2-b2b2-daef5e90fa1c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:25.849137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873d992-b92c-4ab2-b2b2-daef5e90fa1c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:25.882561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b947ca6-8721-42d8-9c84-3a72d34b86d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:25.883334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947ca6-8721-42d8-9c84-3a72d34b86d6 None admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:25.883616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947ca6-8721-42d8-9c84-3a72d34b86d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:25.883889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947ca6-8721-42d8-9c84-3a72d34b86d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:25.884540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b947ca6-8721-42d8-9c84-3a72d34b86d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:25.885924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b947ca6-8721-42d8-9c84-3a72d34b86d6 None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application [None req-1b947ca6-8721-42d8-9c84-3a72d34b86d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 18:47:25.897759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 18:47:25.898870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.get_or_create( May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application with Lock( May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self._enter() May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application return self.creator() May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application created_value = creator( May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 18:47:25.899953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: ERROR keystone.server.flask.application May 04 18:47:25.901462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 659/1304] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 4 18:47:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 18:47:25.904756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f0a47-5d8f-4bf8-bc0f-d69af33e06fd None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:26.004048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f0a47-5d8f-4bf8-bc0f-d69af33e06fd None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:26.038280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4122f8-3e11-4928-8ef7-3636acbb401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:26.038939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4122f8-3e11-4928-8ef7-3636acbb401c None admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:26.039216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4122f8-3e11-4928-8ef7-3636acbb401c None admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:26.039505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4122f8-3e11-4928-8ef7-3636acbb401c None admin] PATH_INFO: `/v3/services` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:26.040222 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4122f8-3e11-4928-8ef7-3636acbb401c None admin] RBAC: Adding query filter params (name=placement) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:47:26.040526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4122f8-3e11-4928-8ef7-3636acbb401c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:26.041934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4122f8-3e11-4928-8ef7-3636acbb401c None admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:26.047457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 646/1305] 10.222.0.35 () {56 vars in 1116 bytes} [Wed May 4 18:47:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:47:26.054286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b947ca6-8721-42d8-9c84-3a72d34b86d6 None admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:47:26.158633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b947ca6-8721-42d8-9c84-3a72d34b86d6 None admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:47:26.194600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1a45f-589b-4725-bad9-f1c43a8d1bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:47:26.195237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1a45f-589b-4725-bad9-f1c43a8d1bfc None admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:47:26.195520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1a45f-589b-4725-bad9-f1c43a8d1bfc None admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:47:26.195787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1a45f-589b-4725-bad9-f1c43a8d1bfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:47:26.196502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1a45f-589b-4725-bad9-f1c43a8d1bfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:47:26.197878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1a45f-589b-4725-bad9-f1c43a8d1bfc None admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:47:26.223876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 660/1306] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 4 18:47:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:48:29.737391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e2ff4-c2ef-4a30-8821-172b5161947c None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:29.738365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e2ff4-c2ef-4a30-8821-172b5161947c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:29.738854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e2ff4-c2ef-4a30-8821-172b5161947c None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:29.744221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 647/1307] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:29.746530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800cf60-5257-4055-92f0-8dad9cef02b3 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:29.747358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800cf60-5257-4055-92f0-8dad9cef02b3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:29.747878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800cf60-5257-4055-92f0-8dad9cef02b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:29.860405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a800cf60-5257-4055-92f0-8dad9cef02b3 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:29.863325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a800cf60-5257-4055-92f0-8dad9cef02b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:30.082972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 661/1308] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:30.132711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfebe62-5521-411f-b61e-c10b922459ee None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:30.132995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfebe62-5521-411f-b61e-c10b922459ee None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:30.133480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfebe62-5521-411f-b61e-c10b922459ee None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:30.135000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 648/1309] 10.222.0.35 () {54 vars in 964 bytes} [Wed May 4 18:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:30.141473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b56d8-d65b-4569-9776-51e7b320f12a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:30.141773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b56d8-d65b-4569-9776-51e7b320f12a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:30.142055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b56d8-d65b-4569-9776-51e7b320f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:30.215225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-971b56d8-d65b-4569-9776-51e7b320f12a None None] MFA Rules not processed for user `94b338c27d664f51bc9de29c9c6ba40e`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:30.216445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-971b56d8-d65b-4569-9776-51e7b320f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:30.292829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 662/1310] 10.222.0.35 () {58 vars in 1061 bytes} [Wed May 4 18:48:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:30.301877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfebe62-5521-411f-b61e-c10b922459ee None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:30.303671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4bfebe62-5521-411f-b61e-c10b922459ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:30.410292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfebe62-5521-411f-b61e-c10b922459ee None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:30.483951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df4ce1-82c7-44fc-b63d-c962ff076c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:30.484607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df4ce1-82c7-44fc-b63d-c962ff076c6a service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:30.484886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df4ce1-82c7-44fc-b63d-c962ff076c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:30.485155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df4ce1-82c7-44fc-b63d-c962ff076c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:30.486859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-32df4ce1-82c7-44fc-b63d-c962ff076c6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:30.602453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df4ce1-82c7-44fc-b63d-c962ff076c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:30.603846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df4ce1-82c7-44fc-b63d-c962ff076c6a service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:30.622136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 649/1311] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:48:33.129156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b0f66-feba-4fe7-94b7-2602f52e9b39 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:33.129705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b0f66-feba-4fe7-94b7-2602f52e9b39 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:33.129705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b0f66-feba-4fe7-94b7-2602f52e9b39 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:33.131045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 663/1312] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:33.136370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e7c08-f521-4490-b465-62a4f6798cf7 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:33.136812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e7c08-f521-4490-b465-62a4f6798cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:33.136927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e7c08-f521-4490-b465-62a4f6798cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:33.208013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-030e7c08-f521-4490-b465-62a4f6798cf7 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:33.209324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-030e7c08-f521-4490-b465-62a4f6798cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:33.305439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 650/1313] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:33.340890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b0f66-feba-4fe7-94b7-2602f52e9b39 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:33.342461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-7e4b0f66-feba-4fe7-94b7-2602f52e9b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:33.445360 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b0f66-feba-4fe7-94b7-2602f52e9b39 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:33.519104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeffce-878b-4d90-ad1b-d9d89fa05c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:33.519759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeffce-878b-4d90-ad1b-d9d89fa05c33 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:33.520034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeffce-878b-4d90-ad1b-d9d89fa05c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:33.520302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeffce-878b-4d90-ad1b-d9d89fa05c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:33.521962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-f2aeffce-878b-4d90-ad1b-d9d89fa05c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:33.632062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aeffce-878b-4d90-ad1b-d9d89fa05c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:33.633539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aeffce-878b-4d90-ad1b-d9d89fa05c33 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:33.652734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 664/1314] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:48:36.222312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c76f9-b813-4267-af4e-3b7b464c326b None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:36.222889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c76f9-b813-4267-af4e-3b7b464c326b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:36.222889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c76f9-b813-4267-af4e-3b7b464c326b None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:36.224283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 651/1315] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:36.230021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c423-53a9-44a7-b972-27c5dfcfc555 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:36.230464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c423-53a9-44a7-b972-27c5dfcfc555 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:36.230567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c423-53a9-44a7-b972-27c5dfcfc555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:36.303836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-ee70c423-53a9-44a7-b972-27c5dfcfc555 None None] MFA Rules not processed for user `e49e7be519494a34b3624efb00d6101f`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:36.305015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ee70c423-53a9-44a7-b972-27c5dfcfc555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:36.417689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 665/1316] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:36.457225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c76f9-b813-4267-af4e-3b7b464c326b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:36.458803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6e7c76f9-b813-4267-af4e-3b7b464c326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:36.565690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c76f9-b813-4267-af4e-3b7b464c326b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:36.652341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419a9a2-494c-414c-b963-b602ac2aa6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:36.653077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419a9a2-494c-414c-b963-b602ac2aa6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:36.653458 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419a9a2-494c-414c-b963-b602ac2aa6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:36.653919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419a9a2-494c-414c-b963-b602ac2aa6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:36.657079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9419a9a2-494c-414c-b963-b602ac2aa6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:36.780977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419a9a2-494c-414c-b963-b602ac2aa6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:36.782359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419a9a2-494c-414c-b963-b602ac2aa6b5 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:36.800794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 652/1317] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:48:39.571414 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c0356-60e9-47af-b68e-0c830a8572f5 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:39.572083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c0356-60e9-47af-b68e-0c830a8572f5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:39.572187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c0356-60e9-47af-b68e-0c830a8572f5 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:39.574133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 666/1318] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:39.582630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33092ea-b2a2-4024-92e3-b8e8729bebfa None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:39.583115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33092ea-b2a2-4024-92e3-b8e8729bebfa None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:39.583495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33092ea-b2a2-4024-92e3-b8e8729bebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:39.671252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-f33092ea-b2a2-4024-92e3-b8e8729bebfa None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:39.672547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f33092ea-b2a2-4024-92e3-b8e8729bebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:39.779293 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 653/1319] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:39.821127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c0356-60e9-47af-b68e-0c830a8572f5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:39.822741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c82c0356-60e9-47af-b68e-0c830a8572f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:39.927438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c0356-60e9-47af-b68e-0c830a8572f5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:40.002642 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f587383-bb75-412e-9764-1d42f249a4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:40.003293 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f587383-bb75-412e-9764-1d42f249a4eb service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:40.003570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f587383-bb75-412e-9764-1d42f249a4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:40.003841 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f587383-bb75-412e-9764-1d42f249a4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:40.005514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8f587383-bb75-412e-9764-1d42f249a4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:40.110802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f587383-bb75-412e-9764-1d42f249a4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:40.112219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f587383-bb75-412e-9764-1d42f249a4eb service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:40.130052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 667/1320] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:48:42.995863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cdfbc-b789-4b2e-98d9-ab35852b357f None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:42.996426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cdfbc-b789-4b2e-98d9-ab35852b357f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:42.996426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cdfbc-b789-4b2e-98d9-ab35852b357f None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:42.997786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 654/1321] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:43.003057 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7533cd-0eb5-43b5-8b0b-7b785a72256e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:43.003469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7533cd-0eb5-43b5-8b0b-7b785a72256e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:43.003603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7533cd-0eb5-43b5-8b0b-7b785a72256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:43.068791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9d7533cd-0eb5-43b5-8b0b-7b785a72256e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:43.070056 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9d7533cd-0eb5-43b5-8b0b-7b785a72256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:43.170105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 668/1322] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:43.205598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cdfbc-b789-4b2e-98d9-ab35852b357f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:43.207125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-dd7cdfbc-b789-4b2e-98d9-ab35852b357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:43.309403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cdfbc-b789-4b2e-98d9-ab35852b357f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:43.381478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c730c-d191-493d-9c14-682a0ef99fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:43.382132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c730c-d191-493d-9c14-682a0ef99fab service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:43.382410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c730c-d191-493d-9c14-682a0ef99fab service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:43.382807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c730c-d191-493d-9c14-682a0ef99fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:43.384474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0f2c730c-d191-493d-9c14-682a0ef99fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:43.499693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c730c-d191-493d-9c14-682a0ef99fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:43.501134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c730c-d191-493d-9c14-682a0ef99fab service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:43.521062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 655/1323] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:48:45.787019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489ac50-5e8b-4b87-989e-f78fac61194d None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:45.787654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489ac50-5e8b-4b87-989e-f78fac61194d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:45.787654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489ac50-5e8b-4b87-989e-f78fac61194d None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:45.789007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 669/1324] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:45.794953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73c7f2-c760-47bc-a7e8-8b455b8ce571 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:45.795448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73c7f2-c760-47bc-a7e8-8b455b8ce571 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:45.795550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73c7f2-c760-47bc-a7e8-8b455b8ce571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:45.859984 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0a73c7f2-c760-47bc-a7e8-8b455b8ce571 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:45.861164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0a73c7f2-c760-47bc-a7e8-8b455b8ce571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:45.955925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 656/1325] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:46.007491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358585b-b925-4c3e-8eed-a3e73518f019 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:46.007754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358585b-b925-4c3e-8eed-a3e73518f019 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:46.008030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358585b-b925-4c3e-8eed-a3e73518f019 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:46.009465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 670/1326] 10.222.0.35 () {54 vars in 964 bytes} [Wed May 4 18:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:46.015792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7e544-7ffe-4191-9a22-c1b11a6f0daa None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:46.016082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7e544-7ffe-4191-9a22-c1b11a6f0daa None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:46.016353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7e544-7ffe-4191-9a22-c1b11a6f0daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:46.088614 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-cad7e544-7ffe-4191-9a22-c1b11a6f0daa None None] MFA Rules not processed for user `94b338c27d664f51bc9de29c9c6ba40e`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:46.089769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cad7e544-7ffe-4191-9a22-c1b11a6f0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:46.166639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 657/1327] 10.222.0.35 () {58 vars in 1061 bytes} [Wed May 4 18:48:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:46.176063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358585b-b925-4c3e-8eed-a3e73518f019 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:46.177891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5358585b-b925-4c3e-8eed-a3e73518f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:46.278460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358585b-b925-4c3e-8eed-a3e73518f019 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:46.350555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4debb52-a42b-4378-9216-c1ebe69fe4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:46.351118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4debb52-a42b-4378-9216-c1ebe69fe4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:46.351397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4debb52-a42b-4378-9216-c1ebe69fe4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:46.351666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4debb52-a42b-4378-9216-c1ebe69fe4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:46.353311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b4debb52-a42b-4378-9216-c1ebe69fe4a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:46.462024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4debb52-a42b-4378-9216-c1ebe69fe4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:46.463497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4debb52-a42b-4378-9216-c1ebe69fe4a5 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:46.481342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 671/1328] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:48:49.001418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dfd91-3ce9-4fa8-94df-183ebee951ab None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:49.001993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dfd91-3ce9-4fa8-94df-183ebee951ab None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:49.001993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dfd91-3ce9-4fa8-94df-183ebee951ab None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:49.003390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 658/1329] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:49.008808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63134dca-e351-4481-a931-c342ab1c4295 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:49.009203 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63134dca-e351-4481-a931-c342ab1c4295 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:49.009401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63134dca-e351-4481-a931-c342ab1c4295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:49.073878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-63134dca-e351-4481-a931-c342ab1c4295 None None] MFA Rules not processed for user `e49e7be519494a34b3624efb00d6101f`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:49.075086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-63134dca-e351-4481-a931-c342ab1c4295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:49.171752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 672/1330] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:49.208283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dfd91-3ce9-4fa8-94df-183ebee951ab None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:49.209879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e99dfd91-3ce9-4fa8-94df-183ebee951ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:49.320418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dfd91-3ce9-4fa8-94df-183ebee951ab None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:49.395681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aafb4-51b5-4e4d-a7ac-45aab86cd408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:49.396335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aafb4-51b5-4e4d-a7ac-45aab86cd408 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:49.396621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aafb4-51b5-4e4d-a7ac-45aab86cd408 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:49.396888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aafb4-51b5-4e4d-a7ac-45aab86cd408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:49.398711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-076aafb4-51b5-4e4d-a7ac-45aab86cd408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:49.513177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aafb4-51b5-4e4d-a7ac-45aab86cd408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:49.514723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aafb4-51b5-4e4d-a7ac-45aab86cd408 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:49.532429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 659/1331] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:48:51.990965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ff5d-4aac-4c70-bc65-72acf0ffa13b None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:51.991450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ff5d-4aac-4c70-bc65-72acf0ffa13b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:51.991542 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ff5d-4aac-4c70-bc65-72acf0ffa13b None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:51.992870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 673/1332] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:51.998859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc884-285a-4ce7-b553-c2390aeea313 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:51.999353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc884-285a-4ce7-b553-c2390aeea313 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:51.999478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc884-285a-4ce7-b553-c2390aeea313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:52.068159 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-93adc884-285a-4ce7-b553-c2390aeea313 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:52.069412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-93adc884-285a-4ce7-b553-c2390aeea313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:52.168795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 660/1333] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:52.204580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ff5d-4aac-4c70-bc65-72acf0ffa13b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:52.206149 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5031ff5d-4aac-4c70-bc65-72acf0ffa13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:52.308560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ff5d-4aac-4c70-bc65-72acf0ffa13b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:52.386280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c7327-04a9-4193-a0aa-c737f04a4c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:52.386939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7327-04a9-4193-a0aa-c737f04a4c69 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:52.387224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7327-04a9-4193-a0aa-c737f04a4c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:52.387499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7327-04a9-4193-a0aa-c737f04a4c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:52.389175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3c6c7327-04a9-4193-a0aa-c737f04a4c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:52.499076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c7327-04a9-4193-a0aa-c737f04a4c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:52.500519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c7327-04a9-4193-a0aa-c737f04a4c69 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:52.518087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 674/1334] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:48:54.768357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f284f2-e47f-492a-9544-dcecf40ce23f None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:54.768871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f284f2-e47f-492a-9544-dcecf40ce23f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:54.768871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f284f2-e47f-492a-9544-dcecf40ce23f None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:54.771183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 661/1335] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:54.780000 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff9a9-c573-43cf-9315-2e2bb00d4ea3 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:54.780400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff9a9-c573-43cf-9315-2e2bb00d4ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:54.780631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff9a9-c573-43cf-9315-2e2bb00d4ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:54.851290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-045ff9a9-c573-43cf-9315-2e2bb00d4ea3 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:54.852504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-045ff9a9-c573-43cf-9315-2e2bb00d4ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:54.946842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 675/1336] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:48:54.995648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f284f2-e47f-492a-9544-dcecf40ce23f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:54.998141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-45f284f2-e47f-492a-9544-dcecf40ce23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:55.126163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f284f2-e47f-492a-9544-dcecf40ce23f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:55.203735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc006133-5296-4895-ab2f-a400352a2949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:55.204382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006133-5296-4895-ab2f-a400352a2949 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:55.204661 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006133-5296-4895-ab2f-a400352a2949 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:55.204933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006133-5296-4895-ab2f-a400352a2949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:55.206610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-dc006133-5296-4895-ab2f-a400352a2949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:55.319197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc006133-5296-4895-ab2f-a400352a2949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:55.320690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc006133-5296-4895-ab2f-a400352a2949 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:55.338709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 662/1337] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:48:58.186452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fafff-9b5c-4611-8256-b0312222743c None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:58.187451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fafff-9b5c-4611-8256-b0312222743c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:58.187451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fafff-9b5c-4611-8256-b0312222743c None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:58.189593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 676/1338] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:48:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:48:58.196219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c84f58-09aa-4577-a927-cbba1129ca96 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:58.196965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c84f58-09aa-4577-a927-cbba1129ca96 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:58.197164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c84f58-09aa-4577-a927-cbba1129ca96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:58.263934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-76c84f58-09aa-4577-a927-cbba1129ca96 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:48:58.265140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-76c84f58-09aa-4577-a927-cbba1129ca96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:58.365405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 663/1339] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:48:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:48:58.411996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fafff-9b5c-4611-8256-b0312222743c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:48:58.413568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-173fafff-9b5c-4611-8256-b0312222743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:58.518594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fafff-9b5c-4611-8256-b0312222743c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:48:58.592965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6090dcc-c596-4250-95ed-b0e1262e1e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:48:58.593692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6090dcc-c596-4250-95ed-b0e1262e1e48 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:48:58.593969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6090dcc-c596-4250-95ed-b0e1262e1e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:48:58.594236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6090dcc-c596-4250-95ed-b0e1262e1e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:48:58.595869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b6090dcc-c596-4250-95ed-b0e1262e1e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:48:58.706386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6090dcc-c596-4250-95ed-b0e1262e1e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:48:58.707727 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6090dcc-c596-4250-95ed-b0e1262e1e48 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:48:58.725790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 677/1340] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:48:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:03.105647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076bde-7d3f-4c62-a21b-e92d12d256c7 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:03.106261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076bde-7d3f-4c62-a21b-e92d12d256c7 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:03.106261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076bde-7d3f-4c62-a21b-e92d12d256c7 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:03.107889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 664/1341] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:03.113117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063abcb-2a61-4e3a-8394-8f60b64d6dc5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:03.113575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063abcb-2a61-4e3a-8394-8f60b64d6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:03.113703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063abcb-2a61-4e3a-8394-8f60b64d6dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:03.185078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6063abcb-2a61-4e3a-8394-8f60b64d6dc5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:03.186209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6063abcb-2a61-4e3a-8394-8f60b64d6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:03.293671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 678/1342] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:03.331308 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86076bde-7d3f-4c62-a21b-e92d12d256c7 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:03.333797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-86076bde-7d3f-4c62-a21b-e92d12d256c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:03.428613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86076bde-7d3f-4c62-a21b-e92d12d256c7 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:03.432931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb85ee-3e55-4b39-8c85-6092ca8aa25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:03.433635 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb85ee-3e55-4b39-8c85-6092ca8aa25d service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:03.433922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb85ee-3e55-4b39-8c85-6092ca8aa25d service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:03.434200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb85ee-3e55-4b39-8c85-6092ca8aa25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:03.444854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb85ee-3e55-4b39-8c85-6092ca8aa25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:03.446258 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb85ee-3e55-4b39-8c85-6092ca8aa25d service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:03.456438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 665/1343] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:06.254166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30d039-f504-4b4b-b098-2ff2fe34f3ce None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:06.254755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30d039-f504-4b4b-b098-2ff2fe34f3ce None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:06.254755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30d039-f504-4b4b-b098-2ff2fe34f3ce None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:06.255977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 679/1344] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:06.261237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1117a-efe9-4639-87a8-f5f4796f2bae None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:06.261728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1117a-efe9-4639-87a8-f5f4796f2bae None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:06.261889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1117a-efe9-4639-87a8-f5f4796f2bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:06.289752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-07e1117a-efe9-4639-87a8-f5f4796f2bae None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:06.291042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-07e1117a-efe9-4639-87a8-f5f4796f2bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:06.368271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 666/1345] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:06.404536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30d039-f504-4b4b-b098-2ff2fe34f3ce None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:06.406650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0d30d039-f504-4b4b-b098-2ff2fe34f3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:06.420936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30d039-f504-4b4b-b098-2ff2fe34f3ce None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:06.424832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ea12-79e6-4ffb-9b44-68dcd2a339f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:06.425486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ea12-79e6-4ffb-9b44-68dcd2a339f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:06.425759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ea12-79e6-4ffb-9b44-68dcd2a339f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:06.426023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ea12-79e6-4ffb-9b44-68dcd2a339f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:06.435264 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46ea12-79e6-4ffb-9b44-68dcd2a339f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:06.436690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46ea12-79e6-4ffb-9b44-68dcd2a339f2 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:06.446759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 680/1346] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:10.954520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c61ec-11c4-4af2-8785-56588b6768e4 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:10.955031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c61ec-11c4-4af2-8785-56588b6768e4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:10.955156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c61ec-11c4-4af2-8785-56588b6768e4 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:10.956473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 667/1347] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:10.961969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5813c9-1774-4cfd-a8cf-f56ac6900818 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:10.962365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5813c9-1774-4cfd-a8cf-f56ac6900818 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:10.962518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5813c9-1774-4cfd-a8cf-f56ac6900818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:10.981023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-ff5813c9-1774-4cfd-a8cf-f56ac6900818 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:10.982261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ff5813c9-1774-4cfd-a8cf-f56ac6900818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:10.990777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 681/1348] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:11.028265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c61ec-11c4-4af2-8785-56588b6768e4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:11.040304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c61ec-11c4-4af2-8785-56588b6768e4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:11.044580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6f68f-cf38-42a8-a949-c7082a29f7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:11.045222 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6f68f-cf38-42a8-a949-c7082a29f7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:11.045545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6f68f-cf38-42a8-a949-c7082a29f7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:11.045820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6f68f-cf38-42a8-a949-c7082a29f7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:11.054675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6f68f-cf38-42a8-a949-c7082a29f7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:11.056112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6f68f-cf38-42a8-a949-c7082a29f7b4 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:11.065311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 668/1349] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:16.311738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fe1c2-e0bb-417e-9b2f-46aac1ec0d91 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:16.312645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fe1c2-e0bb-417e-9b2f-46aac1ec0d91 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:16.313155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fe1c2-e0bb-417e-9b2f-46aac1ec0d91 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:16.315054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 682/1350] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 18:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:16.319865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99771-a271-40fe-bde0-5bbb7182371d None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:16.320280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99771-a271-40fe-bde0-5bbb7182371d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:16.320411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99771-a271-40fe-bde0-5bbb7182371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:16.388303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-37f99771-a271-40fe-bde0-5bbb7182371d None None] MFA Rules not processed for user `f6eaf63f68734bdd938aa0ea7d0c4441`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:16.389887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-37f99771-a271-40fe-bde0-5bbb7182371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:16.463537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 669/1351] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 18:49:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:20.678622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069d76-3cbd-4250-b5ad-2a1e27372ae8 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:20.679147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069d76-3cbd-4250-b5ad-2a1e27372ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:20.679147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069d76-3cbd-4250-b5ad-2a1e27372ae8 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:20.680654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 683/1352] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 18:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:20.685925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1450-68b0-4d10-b43b-0dbcf59df4e5 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:20.686388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1450-68b0-4d10-b43b-0dbcf59df4e5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:20.686808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1450-68b0-4d10-b43b-0dbcf59df4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:20.706784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-648b1450-68b0-4d10-b43b-0dbcf59df4e5 None None] MFA Rules not processed for user `f6eaf63f68734bdd938aa0ea7d0c4441`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:20.708230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-648b1450-68b0-4d10-b43b-0dbcf59df4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:20.717921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 670/1353] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 18:49:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:22.181475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcca1e-7383-436b-ab52-0ff0ecc3c0ee None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:22.182046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcca1e-7383-436b-ab52-0ff0ecc3c0ee None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:22.182046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcca1e-7383-436b-ab52-0ff0ecc3c0ee None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:22.183395 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 684/1354] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 18:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:22.188887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cf5c1-3b0b-4753-8929-446dcb9d41e8 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:22.189371 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cf5c1-3b0b-4753-8929-446dcb9d41e8 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:22.189484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cf5c1-3b0b-4753-8929-446dcb9d41e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:22.209061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d02cf5c1-3b0b-4753-8929-446dcb9d41e8 None None] MFA Rules not processed for user `f6eaf63f68734bdd938aa0ea7d0c4441`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:22.210504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d02cf5c1-3b0b-4753-8929-446dcb9d41e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:22.219680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 671/1355] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 18:49:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:26.141918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d157-3587-476f-b4ba-4aa2142b92c7 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:26.142486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d157-3587-476f-b4ba-4aa2142b92c7 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:26.142486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d157-3587-476f-b4ba-4aa2142b92c7 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:26.143704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 685/1356] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:26.148970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d345c-8800-4eb9-81b3-0c34736942c6 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:26.149456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d345c-8800-4eb9-81b3-0c34736942c6 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:26.149571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d345c-8800-4eb9-81b3-0c34736942c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:26.167402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-2b6d345c-8800-4eb9-81b3-0c34736942c6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:26.168572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2b6d345c-8800-4eb9-81b3-0c34736942c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:26.179080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 672/1357] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:26.223885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85738-0f71-430b-9e48-259ff194b48f None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:26.224365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85738-0f71-430b-9e48-259ff194b48f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:26.224794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85738-0f71-430b-9e48-259ff194b48f None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:26.226561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 686/1358] 10.222.0.35 () {54 vars in 960 bytes} [Wed May 4 18:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:26.232333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfc30-cc67-4e80-a0a7-ef1464fdd295 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:26.232815 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfc30-cc67-4e80-a0a7-ef1464fdd295 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:26.233239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfc30-cc67-4e80-a0a7-ef1464fdd295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:26.285871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-137bfc30-cc67-4e80-a0a7-ef1464fdd295 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:26.287597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-137bfc30-cc67-4e80-a0a7-ef1464fdd295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:26.369437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 673/1359] 10.222.0.35 () {58 vars in 1057 bytes} [Wed May 4 18:49:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:49:26.378371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85738-0f71-430b-9e48-259ff194b48f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:26.393593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85738-0f71-430b-9e48-259ff194b48f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:26.399450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c32b-12ab-4f82-a546-13d4f0fda56b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:26.400140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c32b-12ab-4f82-a546-13d4f0fda56b service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:26.400811 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c32b-12ab-4f82-a546-13d4f0fda56b service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:26.401089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c32b-12ab-4f82-a546-13d4f0fda56b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:26.409598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3c32b-12ab-4f82-a546-13d4f0fda56b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:26.411217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3c32b-12ab-4f82-a546-13d4f0fda56b service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:26.420591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 687/1360] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:49:28.887988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abfbd2-d609-4fe1-a1b9-9b9a52d8d311 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:28.888549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abfbd2-d609-4fe1-a1b9-9b9a52d8d311 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:28.888549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abfbd2-d609-4fe1-a1b9-9b9a52d8d311 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:28.890120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 674/1361] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:28.895247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c48073-68d5-4e61-8da2-80f7eac8229e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:28.895669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c48073-68d5-4e61-8da2-80f7eac8229e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:28.895778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c48073-68d5-4e61-8da2-80f7eac8229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:28.914561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-37c48073-68d5-4e61-8da2-80f7eac8229e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:28.915777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-37c48073-68d5-4e61-8da2-80f7eac8229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:28.925843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 688/1362] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:49:28.971085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abfbd2-d609-4fe1-a1b9-9b9a52d8d311 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:28.986973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abfbd2-d609-4fe1-a1b9-9b9a52d8d311 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:28.994110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035ef6-9005-4919-918b-276cf54b73a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:28.995944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035ef6-9005-4919-918b-276cf54b73a8 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:28.996439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035ef6-9005-4919-918b-276cf54b73a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:28.996927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035ef6-9005-4919-918b-276cf54b73a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:29.008042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e035ef6-9005-4919-918b-276cf54b73a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:29.010254 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e035ef6-9005-4919-918b-276cf54b73a8 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:29.024755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 675/1363] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:31.584557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7456ec9-f553-4b26-91e8-93ec1b43ce3c None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:31.585011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7456ec9-f553-4b26-91e8-93ec1b43ce3c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:31.585108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7456ec9-f553-4b26-91e8-93ec1b43ce3c None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:31.586494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 689/1364] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:31.593355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aecffa-4a76-4b33-bcf9-830c0e6c35c4 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:31.593784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aecffa-4a76-4b33-bcf9-830c0e6c35c4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:31.593899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aecffa-4a76-4b33-bcf9-830c0e6c35c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:31.611647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-31aecffa-4a76-4b33-bcf9-830c0e6c35c4 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:31.612849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-31aecffa-4a76-4b33-bcf9-830c0e6c35c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:31.621232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 676/1365] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:31.667526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58f075-efda-48b8-95a3-04c1b03f65a9 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:31.667776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58f075-efda-48b8-95a3-04c1b03f65a9 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:31.668054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58f075-efda-48b8-95a3-04c1b03f65a9 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:31.669435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 690/1366] 10.222.0.35 () {54 vars in 960 bytes} [Wed May 4 18:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:31.674989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdb2aa-9e65-4644-b703-8891492ff332 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:31.675277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdb2aa-9e65-4644-b703-8891492ff332 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:31.675552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdb2aa-9e65-4644-b703-8891492ff332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:31.694756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-40fdb2aa-9e65-4644-b703-8891492ff332 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:31.695962 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-40fdb2aa-9e65-4644-b703-8891492ff332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:31.705464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 677/1367] 10.222.0.35 () {58 vars in 1057 bytes} [Wed May 4 18:49:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:31.713418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58f075-efda-48b8-95a3-04c1b03f65a9 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:31.728253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58f075-efda-48b8-95a3-04c1b03f65a9 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:31.734765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef94fbf-8d4a-4066-aa0d-557efbb01e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:31.735373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef94fbf-8d4a-4066-aa0d-557efbb01e0b service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:31.735653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef94fbf-8d4a-4066-aa0d-557efbb01e0b service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:31.735926 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef94fbf-8d4a-4066-aa0d-557efbb01e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:31.744574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef94fbf-8d4a-4066-aa0d-557efbb01e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:31.746530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef94fbf-8d4a-4066-aa0d-557efbb01e0b service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:31.755703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 691/1368] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:34.066329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb1a0-1c01-4143-b3f4-9b36b65713ec None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:34.066880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb1a0-1c01-4143-b3f4-9b36b65713ec None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:34.067160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbb1a0-1c01-4143-b3f4-9b36b65713ec None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:34.069614 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 678/1369] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:34.074999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfd392-a5f0-403c-9697-c291cc503dd5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:34.075445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfd392-a5f0-403c-9697-c291cc503dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:34.075527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfd392-a5f0-403c-9697-c291cc503dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:34.095439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-64cfd392-a5f0-403c-9697-c291cc503dd5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:34.096885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-64cfd392-a5f0-403c-9697-c291cc503dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:34.106477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 692/1370] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:49:34.151071 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb1a0-1c01-4143-b3f4-9b36b65713ec None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:34.165718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbb1a0-1c01-4143-b3f4-9b36b65713ec None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:34.171472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2865f4b-546a-48f8-b317-8e20a7eeeaf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:34.172304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2865f4b-546a-48f8-b317-8e20a7eeeaf4 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:34.172747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2865f4b-546a-48f8-b317-8e20a7eeeaf4 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:34.173165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2865f4b-546a-48f8-b317-8e20a7eeeaf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:34.181912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2865f4b-546a-48f8-b317-8e20a7eeeaf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:34.183709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2865f4b-546a-48f8-b317-8e20a7eeeaf4 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:34.196700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 679/1371] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:34.285599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0ca52-449f-4c16-93a8-b77fc0032dff None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:34.285878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0ca52-449f-4c16-93a8-b77fc0032dff None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:34.286167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0ca52-449f-4c16-93a8-b77fc0032dff None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:34.287675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 693/1372] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:34.294306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05c698-6f97-4065-a58b-5fb34165a7ce None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:34.294689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05c698-6f97-4065-a58b-5fb34165a7ce None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:34.294879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05c698-6f97-4065-a58b-5fb34165a7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:34.316640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-da05c698-6f97-4065-a58b-5fb34165a7ce None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:34.318158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-da05c698-6f97-4065-a58b-5fb34165a7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:34.327796 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 680/1373] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:34.639158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af70dd-dcbd-4a1f-832d-ff991ba84ed2 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:34.639158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af70dd-dcbd-4a1f-832d-ff991ba84ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:34.639158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af70dd-dcbd-4a1f-832d-ff991ba84ed2 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:34.641578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 694/1374] 10.222.0.35 () {54 vars in 963 bytes} [Wed May 4 18:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:34.645361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76926cb7-1e52-4276-84d8-f7fe789f51a9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:34.645646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76926cb7-1e52-4276-84d8-f7fe789f51a9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:34.645916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76926cb7-1e52-4276-84d8-f7fe789f51a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:34.695204 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-76926cb7-1e52-4276-84d8-f7fe789f51a9 None None] MFA Rules not processed for user `432759ff503942e7ae6941f9d4b951b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:34.696542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-76926cb7-1e52-4276-84d8-f7fe789f51a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:34.756754 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 681/1375] 10.222.0.35 () {58 vars in 1060 bytes} [Wed May 4 18:49:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:49:34.764306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af70dd-dcbd-4a1f-832d-ff991ba84ed2 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:34.775310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af70dd-dcbd-4a1f-832d-ff991ba84ed2 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:34.778920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56f541-349d-4713-bc40-fd594aaf310e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:34.779555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56f541-349d-4713-bc40-fd594aaf310e service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:34.779858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56f541-349d-4713-bc40-fd594aaf310e service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:34.780126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56f541-349d-4713-bc40-fd594aaf310e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:34.788953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56f541-349d-4713-bc40-fd594aaf310e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:34.790654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56f541-349d-4713-bc40-fd594aaf310e service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:34.801270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 695/1376] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:49:36.503061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db900f-82fe-42d4-af17-0806bb80f6ba None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:36.503667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db900f-82fe-42d4-af17-0806bb80f6ba None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:36.503667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db900f-82fe-42d4-af17-0806bb80f6ba None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:36.505076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 682/1377] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:36.510899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fba369-19be-4d2d-8b90-329cf7b20d04 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:36.511483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fba369-19be-4d2d-8b90-329cf7b20d04 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:36.511483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fba369-19be-4d2d-8b90-329cf7b20d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:36.529143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-75fba369-19be-4d2d-8b90-329cf7b20d04 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:36.530358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-75fba369-19be-4d2d-8b90-329cf7b20d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:36.537968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 696/1378] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:36.583182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db900f-82fe-42d4-af17-0806bb80f6ba None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:36.601007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db900f-82fe-42d4-af17-0806bb80f6ba None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:36.607774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366c771-d82e-4dbb-bce8-b70d86c35f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:36.608424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366c771-d82e-4dbb-bce8-b70d86c35f46 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:36.608706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366c771-d82e-4dbb-bce8-b70d86c35f46 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:36.608979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366c771-d82e-4dbb-bce8-b70d86c35f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:36.618099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366c771-d82e-4dbb-bce8-b70d86c35f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:36.619700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366c771-d82e-4dbb-bce8-b70d86c35f46 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:36.629768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 683/1379] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:38.910472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0784c-8706-4f7b-9a11-96a6c55a12b8 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:38.911090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0784c-8706-4f7b-9a11-96a6c55a12b8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:38.911090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0784c-8706-4f7b-9a11-96a6c55a12b8 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:38.912669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 697/1380] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:38.918094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d7d1-2b4f-4305-8a45-1b9dce6fc5a5 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:38.918542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d7d1-2b4f-4305-8a45-1b9dce6fc5a5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:38.918632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d7d1-2b4f-4305-8a45-1b9dce6fc5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:38.938170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-1cd3d7d1-2b4f-4305-8a45-1b9dce6fc5a5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:38.939356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1cd3d7d1-2b4f-4305-8a45-1b9dce6fc5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:38.948296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 684/1381] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:38.991233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0784c-8706-4f7b-9a11-96a6c55a12b8 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:39.006606 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0784c-8706-4f7b-9a11-96a6c55a12b8 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:39.012895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad1385-acb6-42d1-87aa-ee49043255d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:39.014434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad1385-acb6-42d1-87aa-ee49043255d7 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:39.014807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad1385-acb6-42d1-87aa-ee49043255d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:39.015291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad1385-acb6-42d1-87aa-ee49043255d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:39.024885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad1385-acb6-42d1-87aa-ee49043255d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:39.026787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad1385-acb6-42d1-87aa-ee49043255d7 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:39.036968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 698/1382] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:41.348359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03210a08-a8e8-4e87-90e1-47743d4e05a5 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:41.349046 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03210a08-a8e8-4e87-90e1-47743d4e05a5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:41.349046 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03210a08-a8e8-4e87-90e1-47743d4e05a5 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:41.352390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 685/1383] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:41.356026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf50d-78a1-499a-bfa2-865f2eabfbaf None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:41.356554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf50d-78a1-499a-bfa2-865f2eabfbaf None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:41.356554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf50d-78a1-499a-bfa2-865f2eabfbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:41.376042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-da3bf50d-78a1-499a-bfa2-865f2eabfbaf None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:41.377325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-da3bf50d-78a1-499a-bfa2-865f2eabfbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:41.385513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 699/1384] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:41.427867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03210a08-a8e8-4e87-90e1-47743d4e05a5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:41.443059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03210a08-a8e8-4e87-90e1-47743d4e05a5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:41.449334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0e37b-766b-4064-81ed-aca1b78a0691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:41.450193 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0e37b-766b-4064-81ed-aca1b78a0691 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:41.450663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0e37b-766b-4064-81ed-aca1b78a0691 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:41.450991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0e37b-766b-4064-81ed-aca1b78a0691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:41.464165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0e37b-766b-4064-81ed-aca1b78a0691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:41.466089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0e37b-766b-4064-81ed-aca1b78a0691 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:41.475659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 686/1385] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:43.714955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b27f2b-921b-4434-8208-527d824e557d None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:43.715510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b27f2b-921b-4434-8208-527d824e557d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:43.715722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b27f2b-921b-4434-8208-527d824e557d None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:43.717792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 700/1386] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:43.723419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a819f-d800-4718-a841-ba570e9d9818 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:43.723830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a819f-d800-4718-a841-ba570e9d9818 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:43.723986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a819f-d800-4718-a841-ba570e9d9818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:43.742125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-e52a819f-d800-4718-a841-ba570e9d9818 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:43.743432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e52a819f-d800-4718-a841-ba570e9d9818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:43.752274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 687/1387] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:43.807758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b27f2b-921b-4434-8208-527d824e557d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:43.822849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b27f2b-921b-4434-8208-527d824e557d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:43.829145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63b42c-ac06-4ba4-ae0e-9f0d76f1403f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:43.829821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63b42c-ac06-4ba4-ae0e-9f0d76f1403f service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:43.830102 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63b42c-ac06-4ba4-ae0e-9f0d76f1403f service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:43.830368 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63b42c-ac06-4ba4-ae0e-9f0d76f1403f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:43.839368 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63b42c-ac06-4ba4-ae0e-9f0d76f1403f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:43.841217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63b42c-ac06-4ba4-ae0e-9f0d76f1403f service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:43.852380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 701/1388] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:46.082241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc807-cef5-44aa-a66d-e9831979041b None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:46.082942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc807-cef5-44aa-a66d-e9831979041b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:46.082942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc807-cef5-44aa-a66d-e9831979041b None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:46.084135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 688/1389] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:46.089388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00d93-bab1-4166-a762-c3d8d48849fe None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:46.089837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00d93-bab1-4166-a762-c3d8d48849fe None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:46.089937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00d93-bab1-4166-a762-c3d8d48849fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:46.107440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d7c00d93-bab1-4166-a762-c3d8d48849fe None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:46.108608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d7c00d93-bab1-4166-a762-c3d8d48849fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:46.116419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 702/1390] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:46.163108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc807-cef5-44aa-a66d-e9831979041b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:46.177448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc807-cef5-44aa-a66d-e9831979041b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:46.182887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7181b-7f25-4f6b-bf2d-d9790b83957c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:46.183550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7181b-7f25-4f6b-bf2d-d9790b83957c service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:46.183826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7181b-7f25-4f6b-bf2d-d9790b83957c service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:46.184097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7181b-7f25-4f6b-bf2d-d9790b83957c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:46.192052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7181b-7f25-4f6b-bf2d-d9790b83957c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:46.193673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7181b-7f25-4f6b-bf2d-d9790b83957c service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:46.202723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 689/1391] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:48.433101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd983e2b-3df5-4fb9-853f-cfedebe273e3 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:48.433871 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd983e2b-3df5-4fb9-853f-cfedebe273e3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:48.433871 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd983e2b-3df5-4fb9-853f-cfedebe273e3 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:48.435202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 703/1392] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:48.440715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3cf7-0e06-462e-ab14-651db7c52335 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:48.441195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3cf7-0e06-462e-ab14-651db7c52335 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:48.441339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd3cf7-0e06-462e-ab14-651db7c52335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:48.461228 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-29bd3cf7-0e06-462e-ab14-651db7c52335 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:48.462474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-29bd3cf7-0e06-462e-ab14-651db7c52335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:48.471525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 690/1393] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:48.517143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd983e2b-3df5-4fb9-853f-cfedebe273e3 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:48.532143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd983e2b-3df5-4fb9-853f-cfedebe273e3 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:48.538989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfd300-00a8-48b9-b1bf-bb1331765834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:48.539636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfd300-00a8-48b9-b1bf-bb1331765834 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:48.539929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfd300-00a8-48b9-b1bf-bb1331765834 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:48.540254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfd300-00a8-48b9-b1bf-bb1331765834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:48.548931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfd300-00a8-48b9-b1bf-bb1331765834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:48.550565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfd300-00a8-48b9-b1bf-bb1331765834 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:48.560052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 704/1394] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:50.323246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29b3d7-010d-448d-86c9-fc658d97f2fc None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:50.323826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29b3d7-010d-448d-86c9-fc658d97f2fc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:50.323826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29b3d7-010d-448d-86c9-fc658d97f2fc None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:50.325300 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 691/1395] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:50.330713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc52c-9288-44c5-afa6-2dfcea5c3ad1 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:50.331135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc52c-9288-44c5-afa6-2dfcea5c3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:50.331265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc52c-9288-44c5-afa6-2dfcea5c3ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:50.349628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-8a8bc52c-9288-44c5-afa6-2dfcea5c3ad1 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:50.350817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8a8bc52c-9288-44c5-afa6-2dfcea5c3ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:50.359357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 705/1396] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:50.413412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b567c7-d4fe-4fcd-ab3a-d6a9f59e28f7 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:50.413773 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b567c7-d4fe-4fcd-ab3a-d6a9f59e28f7 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:50.414139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b567c7-d4fe-4fcd-ab3a-d6a9f59e28f7 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:50.415759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 692/1397] 10.222.0.35 () {54 vars in 962 bytes} [Wed May 4 18:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:50.420986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0db7-6d5b-4343-a774-1dff1d6119f2 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:50.421273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0db7-6d5b-4343-a774-1dff1d6119f2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:50.421584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0db7-6d5b-4343-a774-1dff1d6119f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:50.471462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-08bf0db7-6d5b-4343-a774-1dff1d6119f2 None None] MFA Rules not processed for user `63b338ae7e374ba5a7542c5a53deb416`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:50.472671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-08bf0db7-6d5b-4343-a774-1dff1d6119f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:50.532233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 706/1398] 10.222.0.35 () {58 vars in 1059 bytes} [Wed May 4 18:49:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:50.539737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b567c7-d4fe-4fcd-ab3a-d6a9f59e28f7 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:50.551253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b567c7-d4fe-4fcd-ab3a-d6a9f59e28f7 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:50.555023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26266f3-3264-4901-8e7a-e5cb000c3fad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63b338ae7e374ba5a7542c5a53deb416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:50.555643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26266f3-3264-4901-8e7a-e5cb000c3fad service glance] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:50.555924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26266f3-3264-4901-8e7a-e5cb000c3fad service glance] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:50.556196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26266f3-3264-4901-8e7a-e5cb000c3fad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:50.565406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26266f3-3264-4901-8e7a-e5cb000c3fad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:50.566821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26266f3-3264-4901-8e7a-e5cb000c3fad service glance] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:50.576061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 693/1399] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:50.797960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248473-bb00-4d5a-a908-dc8d13af9f02 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:50.798279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248473-bb00-4d5a-a908-dc8d13af9f02 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:50.798541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248473-bb00-4d5a-a908-dc8d13af9f02 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:50.799929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 707/1400] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:50.805908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3abd6b-7743-45a9-81db-d1af43d363ea None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:50.806256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3abd6b-7743-45a9-81db-d1af43d363ea None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:50.806600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3abd6b-7743-45a9-81db-d1af43d363ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:50.825440 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ef3abd6b-7743-45a9-81db-d1af43d363ea None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:50.826699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ef3abd6b-7743-45a9-81db-d1af43d363ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:50.837347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 694/1401] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:50.878288 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248473-bb00-4d5a-a908-dc8d13af9f02 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:50.892222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248473-bb00-4d5a-a908-dc8d13af9f02 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:50.897566 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff29d5-b405-4510-95bb-c0207218ecea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:50.898199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff29d5-b405-4510-95bb-c0207218ecea service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:50.898481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff29d5-b405-4510-95bb-c0207218ecea service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:50.898750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff29d5-b405-4510-95bb-c0207218ecea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:50.906679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff29d5-b405-4510-95bb-c0207218ecea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:50.908241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff29d5-b405-4510-95bb-c0207218ecea service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:50.917445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 708/1402] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:49:50.991933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b82977-73f0-421c-a5f5-6eda2a5cc281 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:50.992218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b82977-73f0-421c-a5f5-6eda2a5cc281 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:50.992501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b82977-73f0-421c-a5f5-6eda2a5cc281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:51.050986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-75b82977-73f0-421c-a5f5-6eda2a5cc281 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:51.052222 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-75b82977-73f0-421c-a5f5-6eda2a5cc281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:51.120987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 695/1403] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 18:49:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:49:51.163087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f58b99-7c5f-44ac-8111-cdef2d2cce09 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:51.163406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f58b99-7c5f-44ac-8111-cdef2d2cce09 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:51.163682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f58b99-7c5f-44ac-8111-cdef2d2cce09 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:51.165019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 709/1404] 10.222.0.35 () {54 vars in 942 bytes} [Wed May 4 18:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:51.171647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e92a9-921e-45e4-ac0d-e5bcac20afd3 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:51.172010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e92a9-921e-45e4-ac0d-e5bcac20afd3 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:51.172501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e92a9-921e-45e4-ac0d-e5bcac20afd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:51.221795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ae5e92a9-921e-45e4-ac0d-e5bcac20afd3 None None] MFA Rules not processed for user `d94a895e3a3547ff9cf35d808c595071`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:51.222979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ae5e92a9-921e-45e4-ac0d-e5bcac20afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:51.296391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 696/1405] 10.222.0.35 () {58 vars in 1039 bytes} [Wed May 4 18:49:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:51.305948 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f58b99-7c5f-44ac-8111-cdef2d2cce09 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:51.321165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f58b99-7c5f-44ac-8111-cdef2d2cce09 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:51.326954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5004a-c9aa-4608-94ee-7a4ae001d1cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:51.327716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5004a-c9aa-4608-94ee-7a4ae001d1cc service swift] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:51.328062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5004a-c9aa-4608-94ee-7a4ae001d1cc service swift] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:51.328390 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5004a-c9aa-4608-94ee-7a4ae001d1cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:51.337200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5004a-c9aa-4608-94ee-7a4ae001d1cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:51.338910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5004a-c9aa-4608-94ee-7a4ae001d1cc service swift] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:51.346757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 710/1406] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 18:49:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:49:53.198429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a21e52-b1ce-4cbf-873f-27a520f2fb77 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:53.199003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a21e52-b1ce-4cbf-873f-27a520f2fb77 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:53.199003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a21e52-b1ce-4cbf-873f-27a520f2fb77 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:53.201623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 697/1407] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:49:53.205817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416133b-d35c-4e29-992c-9e5c5a30fd5e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:53.206668 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416133b-d35c-4e29-992c-9e5c5a30fd5e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:53.207107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416133b-d35c-4e29-992c-9e5c5a30fd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:53.240789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e416133b-d35c-4e29-992c-9e5c5a30fd5e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:49:53.242066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e416133b-d35c-4e29-992c-9e5c5a30fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:49:53.278802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 711/1408] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:49:53.323572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a21e52-b1ce-4cbf-873f-27a520f2fb77 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:49:53.340485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a21e52-b1ce-4cbf-873f-27a520f2fb77 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:49:53.346738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4169d-a10d-4c96-9967-041b497cd653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:49:53.347377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4169d-a10d-4c96-9967-041b497cd653 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:49:53.347653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4169d-a10d-4c96-9967-041b497cd653 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:49:53.347924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4169d-a10d-4c96-9967-041b497cd653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:49:53.356722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4169d-a10d-4c96-9967-041b497cd653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:49:53.358338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4169d-a10d-4c96-9967-041b497cd653 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:49:53.377718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 698/1409] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:15.181830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23ab39-ea44-41dc-9d1f-f4458afda497 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:15.182495 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23ab39-ea44-41dc-9d1f-f4458afda497 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:15.182495 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23ab39-ea44-41dc-9d1f-f4458afda497 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:15.183707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 712/1410] 10.222.0.35 () {54 vars in 918 bytes} [Wed May 4 18:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:15.189218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ffda-6964-422c-8c90-b1abed54d01c None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:15.189693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ffda-6964-422c-8c90-b1abed54d01c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:15.189800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ffda-6964-422c-8c90-b1abed54d01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:15.210070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0499ffda-6964-422c-8c90-b1abed54d01c None None] MFA Rules not processed for user `f6eaf63f68734bdd938aa0ea7d0c4441`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:15.211272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0499ffda-6964-422c-8c90-b1abed54d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:15.221534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 699/1411] 10.222.0.35 () {58 vars in 1015 bytes} [Wed May 4 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:15.236263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b62de2-446f-46c4-9443-044533b616a8 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:15.236546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b62de2-446f-46c4-9443-044533b616a8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:15.236815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b62de2-446f-46c4-9443-044533b616a8 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:15.238188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 713/1412] 10.222.0.35 () {54 vars in 918 bytes} [Wed May 4 18:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:15.242914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886783f1-3c6e-4012-bb47-56ddb71579d9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:15.243195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886783f1-3c6e-4012-bb47-56ddb71579d9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:15.243469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886783f1-3c6e-4012-bb47-56ddb71579d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:15.262806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-886783f1-3c6e-4012-bb47-56ddb71579d9 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:15.263978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-886783f1-3c6e-4012-bb47-56ddb71579d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:15.274694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 700/1413] 10.222.0.35 () {58 vars in 1015 bytes} [Wed May 4 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:18.021113 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f3571-787b-4a21-a3d3-d9c927f9d193 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:18.021795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f3571-787b-4a21-a3d3-d9c927f9d193 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:18.021795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f3571-787b-4a21-a3d3-d9c927f9d193 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:18.023194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:18.029158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068a086-b512-42eb-a881-79030bd85a14 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:18.029683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068a086-b512-42eb-a881-79030bd85a14 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:18.029796 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068a086-b512-42eb-a881-79030bd85a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:18.053505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9068a086-b512-42eb-a881-79030bd85a14 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:18.054673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9068a086-b512-42eb-a881-79030bd85a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:18.064115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:18.109222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f3571-787b-4a21-a3d3-d9c927f9d193 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:18.125638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f3571-787b-4a21-a3d3-d9c927f9d193 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:18.132355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a6df-795d-4344-bd74-9e3e5aea8a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:18.132996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a6df-795d-4344-bd74-9e3e5aea8a76 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:18.133277 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a6df-795d-4344-bd74-9e3e5aea8a76 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:18.133579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a6df-795d-4344-bd74-9e3e5aea8a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:18.141876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a6df-795d-4344-bd74-9e3e5aea8a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:18.143456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a6df-795d-4344-bd74-9e3e5aea8a76 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:18.153296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 715/1416] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:19.456864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc618c6a-53e8-4c0c-bb31-dca59c7f6965 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:19.457361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc618c6a-53e8-4c0c-bb31-dca59c7f6965 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:19.457489 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc618c6a-53e8-4c0c-bb31-dca59c7f6965 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:19.458827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:19.464065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072274-4c33-475e-a88a-aeb8e7b55f7a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:19.464524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072274-4c33-475e-a88a-aeb8e7b55f7a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:19.464624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f072274-4c33-475e-a88a-aeb8e7b55f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:19.483990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-0f072274-4c33-475e-a88a-aeb8e7b55f7a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:19.485175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0f072274-4c33-475e-a88a-aeb8e7b55f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:19.494169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:19.689042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc618c6a-53e8-4c0c-bb31-dca59c7f6965 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:19.709370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc618c6a-53e8-4c0c-bb31-dca59c7f6965 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:19.715639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147e87d-9a35-4154-ad58-7340e3366dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:19.716307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147e87d-9a35-4154-ad58-7340e3366dc1 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:19.716585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147e87d-9a35-4154-ad58-7340e3366dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:19.716875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147e87d-9a35-4154-ad58-7340e3366dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:19.725934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147e87d-9a35-4154-ad58-7340e3366dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:19.727582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147e87d-9a35-4154-ad58-7340e3366dc1 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:19.737655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 703/1419] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:20.987047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325856a-6dcd-4b6d-a3af-0d94dc05e40f None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:20.987826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325856a-6dcd-4b6d-a3af-0d94dc05e40f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:20.987826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325856a-6dcd-4b6d-a3af-0d94dc05e40f None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:20.989896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:50:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:20.998421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0308c-9c3f-40bc-ab39-f583bf1a1f62 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:20.998873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0308c-9c3f-40bc-ab39-f583bf1a1f62 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:20.999026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0308c-9c3f-40bc-ab39-f583bf1a1f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:21.022831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c2b0308c-9c3f-40bc-ab39-f583bf1a1f62 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:21.024040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c2b0308c-9c3f-40bc-ab39-f583bf1a1f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:21.034860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:21.186993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325856a-6dcd-4b6d-a3af-0d94dc05e40f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:21.203152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325856a-6dcd-4b6d-a3af-0d94dc05e40f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:21.209534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac84efc-7a9b-4ac6-9b14-2346e409bde5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:21.210212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84efc-7a9b-4ac6-9b14-2346e409bde5 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:21.210533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84efc-7a9b-4ac6-9b14-2346e409bde5 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:21.210824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84efc-7a9b-4ac6-9b14-2346e409bde5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:21.219803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac84efc-7a9b-4ac6-9b14-2346e409bde5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:21.221429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac84efc-7a9b-4ac6-9b14-2346e409bde5 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:21.230633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 718/1422] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:22.475505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22b99b-3bb6-40da-92f6-c4dd8dc6261e None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:22.475962 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22b99b-3bb6-40da-92f6-c4dd8dc6261e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:22.476077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22b99b-3bb6-40da-92f6-c4dd8dc6261e None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:22.477443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:22.482590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825336f-0464-42c6-9241-d7b9a7b73152 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:22.483016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825336f-0464-42c6-9241-d7b9a7b73152 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:22.483132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825336f-0464-42c6-9241-d7b9a7b73152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:22.502598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d825336f-0464-42c6-9241-d7b9a7b73152 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:22.503820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d825336f-0464-42c6-9241-d7b9a7b73152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:22.512921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:22.663013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22b99b-3bb6-40da-92f6-c4dd8dc6261e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:22.685562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22b99b-3bb6-40da-92f6-c4dd8dc6261e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:22.692199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e9498-9d1c-4f97-b937-39ee5ea32e32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:22.692834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9498-9d1c-4f97-b937-39ee5ea32e32 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:22.693114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9498-9d1c-4f97-b937-39ee5ea32e32 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:22.693410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9498-9d1c-4f97-b937-39ee5ea32e32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:22.702163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e9498-9d1c-4f97-b937-39ee5ea32e32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:22.703768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e9498-9d1c-4f97-b937-39ee5ea32e32 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:22.713528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 706/1425] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:23.954827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78a30e-3159-451a-becb-818719b559e1 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:23.955697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78a30e-3159-451a-becb-818719b559e1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:23.955697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78a30e-3159-451a-becb-818719b559e1 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:23.957922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:50:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:23.963651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42ba2f-461b-4907-b6eb-ef7c157b31b8 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:23.964139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42ba2f-461b-4907-b6eb-ef7c157b31b8 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:23.964236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42ba2f-461b-4907-b6eb-ef7c157b31b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:23.987882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8d42ba2f-461b-4907-b6eb-ef7c157b31b8 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:23.989088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8d42ba2f-461b-4907-b6eb-ef7c157b31b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:23.998689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:24.153700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78a30e-3159-451a-becb-818719b559e1 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:24.177969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78a30e-3159-451a-becb-818719b559e1 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:24.185216 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c3498-129a-4019-9408-fb6619c6856b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:24.185883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c3498-129a-4019-9408-fb6619c6856b service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:24.186152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c3498-129a-4019-9408-fb6619c6856b service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:24.186424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c3498-129a-4019-9408-fb6619c6856b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:24.195150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c3498-129a-4019-9408-fb6619c6856b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:24.196753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c3498-129a-4019-9408-fb6619c6856b service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:24.208458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 721/1428] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:25.386411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb7e5d-cc16-452a-bdba-20354ed86359 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:25.386961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb7e5d-cc16-452a-bdba-20354ed86359 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:25.386961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb7e5d-cc16-452a-bdba-20354ed86359 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:25.388314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:25.393951 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0df70-fce2-4523-96d7-3fac796b433c None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:25.394423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0df70-fce2-4523-96d7-3fac796b433c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:25.394523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0df70-fce2-4523-96d7-3fac796b433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:25.413574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-78d0df70-fce2-4523-96d7-3fac796b433c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:25.414775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-78d0df70-fce2-4523-96d7-3fac796b433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:25.423219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:50:25.584402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb7e5d-cc16-452a-bdba-20354ed86359 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:25.601795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb7e5d-cc16-452a-bdba-20354ed86359 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:25.608417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e601103-9d9e-42c3-ad85-13d0ee390ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:25.609111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e601103-9d9e-42c3-ad85-13d0ee390ad8 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:25.609412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e601103-9d9e-42c3-ad85-13d0ee390ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:25.609687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e601103-9d9e-42c3-ad85-13d0ee390ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:25.618533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e601103-9d9e-42c3-ad85-13d0ee390ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:25.620186 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e601103-9d9e-42c3-ad85-13d0ee390ad8 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:25.630106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 709/1431] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:26.818347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05238c4e-75f3-489e-a0e3-ec26a088ab3d None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:26.818804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05238c4e-75f3-489e-a0e3-ec26a088ab3d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:26.818934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05238c4e-75f3-489e-a0e3-ec26a088ab3d None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:26.820261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:26.825436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd54d1-8133-4276-bf6e-5b945bbb6b1e None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:26.825905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd54d1-8133-4276-bf6e-5b945bbb6b1e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:26.826124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd54d1-8133-4276-bf6e-5b945bbb6b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:26.846409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-18bd54d1-8133-4276-bf6e-5b945bbb6b1e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:26.847667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-18bd54d1-8133-4276-bf6e-5b945bbb6b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:26.856223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:27.004590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05238c4e-75f3-489e-a0e3-ec26a088ab3d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:27.022895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05238c4e-75f3-489e-a0e3-ec26a088ab3d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:27.032789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e11ecd-b0aa-46c5-bb0f-5327d429884a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:27.033472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e11ecd-b0aa-46c5-bb0f-5327d429884a service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:27.033755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e11ecd-b0aa-46c5-bb0f-5327d429884a service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:27.034029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e11ecd-b0aa-46c5-bb0f-5327d429884a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:27.043531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e11ecd-b0aa-46c5-bb0f-5327d429884a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:27.045120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e11ecd-b0aa-46c5-bb0f-5327d429884a service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:27.055231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 724/1434] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:28.241647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8b06d-6474-4259-ada1-a8cbc109dd26 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:28.242278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8b06d-6474-4259-ada1-a8cbc109dd26 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:28.242278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8b06d-6474-4259-ada1-a8cbc109dd26 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:28.243541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:28.249768 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb33d-3119-40ee-ac00-5e621081b3f4 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:28.250189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb33d-3119-40ee-ac00-5e621081b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:28.250308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb33d-3119-40ee-ac00-5e621081b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:28.272690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9dedb33d-3119-40ee-ac00-5e621081b3f4 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:28.273945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9dedb33d-3119-40ee-ac00-5e621081b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:28.283207 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:28.431934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8b06d-6474-4259-ada1-a8cbc109dd26 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:28.451208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8b06d-6474-4259-ada1-a8cbc109dd26 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:28.458166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c6c79-3338-4936-b0df-eda239c2a767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:28.458814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6c79-3338-4936-b0df-eda239c2a767 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:28.459088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6c79-3338-4936-b0df-eda239c2a767 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:28.459354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6c79-3338-4936-b0df-eda239c2a767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:28.468034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c6c79-3338-4936-b0df-eda239c2a767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:28.469674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c6c79-3338-4936-b0df-eda239c2a767 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:28.478989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 712/1437] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:29.661647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e3672-c27d-4760-8046-4a88f9fe33d4 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:29.662539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e3672-c27d-4760-8046-4a88f9fe33d4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:29.662539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e3672-c27d-4760-8046-4a88f9fe33d4 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:29.664816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:50:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:29.669892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b2a3d-b044-451c-b280-eeb4a5ee6620 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:29.670318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b2a3d-b044-451c-b280-eeb4a5ee6620 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:29.670429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b2a3d-b044-451c-b280-eeb4a5ee6620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:29.688478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-cd1b2a3d-b044-451c-b280-eeb4a5ee6620 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:29.689687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cd1b2a3d-b044-451c-b280-eeb4a5ee6620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:29.697993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:29.843810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e3672-c27d-4760-8046-4a88f9fe33d4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:29.862537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e3672-c27d-4760-8046-4a88f9fe33d4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:29.867958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385941d-9bc6-406e-a936-e797dc7b0a8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:29.868597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385941d-9bc6-406e-a936-e797dc7b0a8e service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:29.868878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385941d-9bc6-406e-a936-e797dc7b0a8e service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:29.869154 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385941d-9bc6-406e-a936-e797dc7b0a8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:29.877926 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385941d-9bc6-406e-a936-e797dc7b0a8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:29.879514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385941d-9bc6-406e-a936-e797dc7b0a8e service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:29.889186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 727/1440] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:31.992725 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5de3ee-a5bf-4784-8abd-36f7354ea12d None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:31.993351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5de3ee-a5bf-4784-8abd-36f7354ea12d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:31.993351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5de3ee-a5bf-4784-8abd-36f7354ea12d None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:31.994755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:32.000407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f7c53-60bd-46f1-9c71-5f811ef4ffc5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:32.000927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f7c53-60bd-46f1-9c71-5f811ef4ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:32.001031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f7c53-60bd-46f1-9c71-5f811ef4ffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:32.018734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a23f7c53-60bd-46f1-9c71-5f811ef4ffc5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:32.019948 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a23f7c53-60bd-46f1-9c71-5f811ef4ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:32.028597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:32.066723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5de3ee-a5bf-4784-8abd-36f7354ea12d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:32.078468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5de3ee-a5bf-4784-8abd-36f7354ea12d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:32.082118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ba75-9ffe-4ff8-92a3-a456104ef8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:32.082750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ba75-9ffe-4ff8-92a3-a456104ef8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:32.083027 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ba75-9ffe-4ff8-92a3-a456104ef8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:32.083299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ba75-9ffe-4ff8-92a3-a456104ef8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:32.092672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ba75-9ffe-4ff8-92a3-a456104ef8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:32.094174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ba75-9ffe-4ff8-92a3-a456104ef8a0 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:32.104370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 715/1443] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:34.482244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a367-e2f2-4918-9f45-e1d175041e2e None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:34.482897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a367-e2f2-4918-9f45-e1d175041e2e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:34.482897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a367-e2f2-4918-9f45-e1d175041e2e None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:34.484296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:34.490784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744fd27-b6b1-4647-bb30-a3c0eefbd1bf None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:34.491234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744fd27-b6b1-4647-bb30-a3c0eefbd1bf None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:34.491343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744fd27-b6b1-4647-bb30-a3c0eefbd1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:34.511291 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-2744fd27-b6b1-4647-bb30-a3c0eefbd1bf None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:34.512513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2744fd27-b6b1-4647-bb30-a3c0eefbd1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:34.521632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:34.559386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9a367-e2f2-4918-9f45-e1d175041e2e None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:34.572049 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9a367-e2f2-4918-9f45-e1d175041e2e None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:34.576095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4bb74-e91f-4d13-bff0-edbaf4a6b0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:34.576734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4bb74-e91f-4d13-bff0-edbaf4a6b0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:34.576989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4bb74-e91f-4d13-bff0-edbaf4a6b0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:34.577304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4bb74-e91f-4d13-bff0-edbaf4a6b0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:34.588413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4bb74-e91f-4d13-bff0-edbaf4a6b0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:34.589888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4bb74-e91f-4d13-bff0-edbaf4a6b0a8 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:34.599964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 730/1446] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:37.122080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d08896-e450-453c-8d2f-44a8937749e3 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:37.122694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d08896-e450-453c-8d2f-44a8937749e3 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:37.122694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d08896-e450-453c-8d2f-44a8937749e3 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:37.124721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:37.132903 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ca2b-c466-4492-8b36-60a104917e07 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:37.133427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ca2b-c466-4492-8b36-60a104917e07 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:37.133549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ca2b-c466-4492-8b36-60a104917e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:37.153668 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-8978ca2b-c466-4492-8b36-60a104917e07 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:37.154854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8978ca2b-c466-4492-8b36-60a104917e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:37.163144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:50:37.202110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d08896-e450-453c-8d2f-44a8937749e3 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:37.214889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d08896-e450-453c-8d2f-44a8937749e3 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:37.220841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7344e-8160-4ec6-b089-eec7c305a25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:37.221710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7344e-8160-4ec6-b089-eec7c305a25e service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:37.222075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7344e-8160-4ec6-b089-eec7c305a25e service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:37.222456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7344e-8160-4ec6-b089-eec7c305a25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:37.234069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7344e-8160-4ec6-b089-eec7c305a25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:37.235565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7344e-8160-4ec6-b089-eec7c305a25e service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:37.244928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 718/1449] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:39.647222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6d2ed-5861-41d8-9f75-2f8286d8fe02 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:39.647801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6d2ed-5861-41d8-9f75-2f8286d8fe02 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:39.647801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6d2ed-5861-41d8-9f75-2f8286d8fe02 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:39.649181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:39.655552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469612-996d-4bcd-9e3e-2a5c7e8a9125 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:39.656239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469612-996d-4bcd-9e3e-2a5c7e8a9125 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:39.656422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469612-996d-4bcd-9e3e-2a5c7e8a9125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:39.678626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-40469612-996d-4bcd-9e3e-2a5c7e8a9125 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:39.679806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-40469612-996d-4bcd-9e3e-2a5c7e8a9125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:39.689462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:39.730030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6d2ed-5861-41d8-9f75-2f8286d8fe02 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:39.741911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6d2ed-5861-41d8-9f75-2f8286d8fe02 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:39.746464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281011e0-fc7c-4371-bc50-f30cabe6e250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:39.747104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281011e0-fc7c-4371-bc50-f30cabe6e250 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:39.747388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281011e0-fc7c-4371-bc50-f30cabe6e250 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:39.747660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281011e0-fc7c-4371-bc50-f30cabe6e250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:39.756584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281011e0-fc7c-4371-bc50-f30cabe6e250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:39.758063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281011e0-fc7c-4371-bc50-f30cabe6e250 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:39.767499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 733/1452] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:42.076499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8eaf9-a1f4-4a36-b151-f7f0597238b2 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:42.077156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8eaf9-a1f4-4a36-b151-f7f0597238b2 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:42.077156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8eaf9-a1f4-4a36-b151-f7f0597238b2 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:42.078481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:42.084954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd929fe-9048-44b9-82c1-6675c4a67ca9 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:42.085844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd929fe-9048-44b9-82c1-6675c4a67ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:42.085844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd929fe-9048-44b9-82c1-6675c4a67ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:42.105813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-8cd929fe-9048-44b9-82c1-6675c4a67ca9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:42.107028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8cd929fe-9048-44b9-82c1-6675c4a67ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:42.116185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:42.155281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8eaf9-a1f4-4a36-b151-f7f0597238b2 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:42.173674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8eaf9-a1f4-4a36-b151-f7f0597238b2 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:42.180548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5124315-29ed-4fc5-b972-42b26a01d065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:42.181500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5124315-29ed-4fc5-b972-42b26a01d065 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:42.181778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5124315-29ed-4fc5-b972-42b26a01d065 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:42.182048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5124315-29ed-4fc5-b972-42b26a01d065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:42.192395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5124315-29ed-4fc5-b972-42b26a01d065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:42.193884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5124315-29ed-4fc5-b972-42b26a01d065 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:42.204208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 721/1455] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:44.555862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843e0f3-9da9-4523-9403-5f9aac6aa7cc None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:44.556494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843e0f3-9da9-4523-9403-5f9aac6aa7cc None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:44.556494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843e0f3-9da9-4523-9403-5f9aac6aa7cc None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:44.557998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:44.564532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bfdcc-1225-4cb2-889f-9775d866817c None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:44.565274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bfdcc-1225-4cb2-889f-9775d866817c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:44.565442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bfdcc-1225-4cb2-889f-9775d866817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:44.594528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-5a0bfdcc-1225-4cb2-889f-9775d866817c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:44.596043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5a0bfdcc-1225-4cb2-889f-9775d866817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:44.605278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:44.648425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843e0f3-9da9-4523-9403-5f9aac6aa7cc None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:44.660498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843e0f3-9da9-4523-9403-5f9aac6aa7cc None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:44.664880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc3d2d-f746-40af-890c-cc2a09b8f2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:44.665658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc3d2d-f746-40af-890c-cc2a09b8f2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:44.665941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc3d2d-f746-40af-890c-cc2a09b8f2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:44.666218 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc3d2d-f746-40af-890c-cc2a09b8f2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:44.675460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc3d2d-f746-40af-890c-cc2a09b8f2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:44.676889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc3d2d-f746-40af-890c-cc2a09b8f2f8 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:44.686412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 736/1458] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:46.971732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd22a9f-1eb7-4f8b-baec-25c1e7d03337 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:46.972368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd22a9f-1eb7-4f8b-baec-25c1e7d03337 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:46.972368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd22a9f-1eb7-4f8b-baec-25c1e7d03337 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:46.974245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:46.979670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f1bc2-cc19-4a0e-9a57-ceebd2c8825a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:46.980146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f1bc2-cc19-4a0e-9a57-ceebd2c8825a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:46.980259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f1bc2-cc19-4a0e-9a57-ceebd2c8825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:46.999401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-ef6f1bc2-cc19-4a0e-9a57-ceebd2c8825a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:47.000584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ef6f1bc2-cc19-4a0e-9a57-ceebd2c8825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:47.009224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:47.048502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd22a9f-1eb7-4f8b-baec-25c1e7d03337 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:47.064748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd22a9f-1eb7-4f8b-baec-25c1e7d03337 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:47.068662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b53f58-0eab-4733-89b1-8c54084dfafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:47.069325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53f58-0eab-4733-89b1-8c54084dfafb service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:47.069607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53f58-0eab-4733-89b1-8c54084dfafb service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:47.069880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53f58-0eab-4733-89b1-8c54084dfafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:47.079093 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b53f58-0eab-4733-89b1-8c54084dfafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:47.080525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b53f58-0eab-4733-89b1-8c54084dfafb service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:47.089826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 724/1461] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:49.370209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af72aa1-fbe3-40e9-9be9-f054cfce97be None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:49.370956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af72aa1-fbe3-40e9-9be9-f054cfce97be None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:49.370956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af72aa1-fbe3-40e9-9be9-f054cfce97be None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:49.372844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:49.380033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee1df-0e0c-4429-8128-76e5cbe3d665 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:49.380770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee1df-0e0c-4429-8128-76e5cbe3d665 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:49.380957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee1df-0e0c-4429-8128-76e5cbe3d665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:49.400593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ea7ee1df-0e0c-4429-8128-76e5cbe3d665 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:49.401845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ea7ee1df-0e0c-4429-8128-76e5cbe3d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:49.410238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:49.448733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af72aa1-fbe3-40e9-9be9-f054cfce97be None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:49.460479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af72aa1-fbe3-40e9-9be9-f054cfce97be None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:49.464447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ec457-f3b8-4944-901b-f0b159a883d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:49.465092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ec457-f3b8-4944-901b-f0b159a883d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:49.465398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ec457-f3b8-4944-901b-f0b159a883d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:49.465670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ec457-f3b8-4944-901b-f0b159a883d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:49.475206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ec457-f3b8-4944-901b-f0b159a883d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:49.476619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ec457-f3b8-4944-901b-f0b159a883d0 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:49.486344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 739/1464] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:50:51.741061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86a713-06fa-49ec-b257-f5107feee349 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:51.741701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86a713-06fa-49ec-b257-f5107feee349 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:51.741701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86a713-06fa-49ec-b257-f5107feee349 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:51.742961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:51.749814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54563336-d458-4b3e-9860-b78420f6a293 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:51.750530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54563336-d458-4b3e-9860-b78420f6a293 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:51.750690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54563336-d458-4b3e-9860-b78420f6a293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:51.772320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-54563336-d458-4b3e-9860-b78420f6a293 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:51.773574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-54563336-d458-4b3e-9860-b78420f6a293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:51.782307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:51.821444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86a713-06fa-49ec-b257-f5107feee349 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:51.832545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86a713-06fa-49ec-b257-f5107feee349 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:51.836224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856a5e5-1059-4b77-9832-0f71a69b9913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:51.836863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856a5e5-1059-4b77-9832-0f71a69b9913 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:51.837306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856a5e5-1059-4b77-9832-0f71a69b9913 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:51.837595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856a5e5-1059-4b77-9832-0f71a69b9913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:51.846487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856a5e5-1059-4b77-9832-0f71a69b9913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:51.847918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856a5e5-1059-4b77-9832-0f71a69b9913 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:51.857184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 727/1467] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:50:54.087336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5f62-fbfa-4ab8-8538-9d0d9899d78b None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:54.087944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5f62-fbfa-4ab8-8538-9d0d9899d78b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:54.087944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5f62-fbfa-4ab8-8538-9d0d9899d78b None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:54.089242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:50:54.095621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce77b-199b-4509-852e-4b3df464860a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:54.096097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce77b-199b-4509-852e-4b3df464860a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:54.096190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce77b-199b-4509-852e-4b3df464860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:54.117696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c57ce77b-199b-4509-852e-4b3df464860a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:50:54.118912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c57ce77b-199b-4509-852e-4b3df464860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:50:54.127548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:50:54.166461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5f62-fbfa-4ab8-8538-9d0d9899d78b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:50:54.178320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5f62-fbfa-4ab8-8538-9d0d9899d78b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:50:54.182489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ef64-37cb-4c73-922b-92af3db1a3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:50:54.183128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ef64-37cb-4c73-922b-92af3db1a3dd service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:50:54.183430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ef64-37cb-4c73-922b-92af3db1a3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:50:54.183676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ef64-37cb-4c73-922b-92af3db1a3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:50:54.192676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ef64-37cb-4c73-922b-92af3db1a3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:50:54.194124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ef64-37cb-4c73-922b-92af3db1a3dd service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:50:54.203236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 742/1470] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:51:27.163029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c131cb-22c3-4ea0-8daf-501b63b7ec20 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:27.163620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c131cb-22c3-4ea0-8daf-501b63b7ec20 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:27.163620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c131cb-22c3-4ea0-8daf-501b63b7ec20 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:27.164910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 729/1471] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:27.170473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672f68f-0d46-4dcd-b976-50873606d7c6 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:27.170920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672f68f-0d46-4dcd-b976-50873606d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:27.171023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672f68f-0d46-4dcd-b976-50873606d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:27.190146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a672f68f-0d46-4dcd-b976-50873606d7c6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:27.191350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a672f68f-0d46-4dcd-b976-50873606d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:27.200179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 743/1472] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:51:27.246208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a53dd9-1b2d-4f99-a1e4-3d129cbbf12b None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:27.246862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a53dd9-1b2d-4f99-a1e4-3d129cbbf12b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:27.247139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a53dd9-1b2d-4f99-a1e4-3d129cbbf12b None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:27.248534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 730/1473] 10.222.0.35 () {54 vars in 962 bytes} [Wed May 4 18:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:27.253392 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0901ef2-a468-49d5-a7a0-fb1c113c7ea0 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:27.253676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0901ef2-a468-49d5-a7a0-fb1c113c7ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:27.253950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0901ef2-a468-49d5-a7a0-fb1c113c7ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:27.272968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a0901ef2-a468-49d5-a7a0-fb1c113c7ea0 None None] MFA Rules not processed for user `63b338ae7e374ba5a7542c5a53deb416`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:27.274191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a0901ef2-a468-49d5-a7a0-fb1c113c7ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:27.281031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 744/1474] 10.222.0.35 () {58 vars in 1059 bytes} [Wed May 4 18:51:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:51:27.288188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a53dd9-1b2d-4f99-a1e4-3d129cbbf12b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:27.299174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a53dd9-1b2d-4f99-a1e4-3d129cbbf12b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:27.302975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d38ba5-0f8f-4504-b485-fb3487f41fbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63b338ae7e374ba5a7542c5a53deb416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:27.303628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38ba5-0f8f-4504-b485-fb3487f41fbe service glance] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:27.303904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38ba5-0f8f-4504-b485-fb3487f41fbe service glance] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:27.304179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38ba5-0f8f-4504-b485-fb3487f41fbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:27.313253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d38ba5-0f8f-4504-b485-fb3487f41fbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:27.314711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d38ba5-0f8f-4504-b485-fb3487f41fbe service glance] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:27.324583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 731/1475] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:51:29.674243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e2b4-72a7-48d5-bb4f-b4889e13ec5a None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:29.675066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e2b4-72a7-48d5-bb4f-b4889e13ec5a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:29.675066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e2b4-72a7-48d5-bb4f-b4889e13ec5a None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:29.677369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 745/1476] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:51:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:29.686250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854a63-54df-40e5-93df-d80eb1c233e2 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:29.686971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854a63-54df-40e5-93df-d80eb1c233e2 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:29.687151 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854a63-54df-40e5-93df-d80eb1c233e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:29.708901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-97854a63-54df-40e5-93df-d80eb1c233e2 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:29.710067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-97854a63-54df-40e5-93df-d80eb1c233e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:29.718849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 732/1477] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:51:29.742400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e2b4-72a7-48d5-bb4f-b4889e13ec5a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:29.762397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e2b4-72a7-48d5-bb4f-b4889e13ec5a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:29.768407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc7666-f1e0-4461-94af-290ea9fdd0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:29.769060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7666-f1e0-4461-94af-290ea9fdd0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:29.769375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7666-f1e0-4461-94af-290ea9fdd0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:29.769648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7666-f1e0-4461-94af-290ea9fdd0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:29.770390 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc7666-f1e0-4461-94af-290ea9fdd0a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:29.772194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING py.warnings [None req-f1bc7666-f1e0-4461-94af-290ea9fdd0a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:51:29.772194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: warnings.warn(msg) May 04 18:51:29.772194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: May 04 18:51:29.773359 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc7666-f1e0-4461-94af-290ea9fdd0a9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:29.795789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 746/1478] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 4 18:51:29 2022] GET /identity/v3/projects => generated 2553 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:51:32.044820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd58dc-c3ce-4a12-bbd4-f2212a39ad4c None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:32.045446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd58dc-c3ce-4a12-bbd4-f2212a39ad4c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:32.045446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd58dc-c3ce-4a12-bbd4-f2212a39ad4c None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:32.046731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 733/1479] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:32.053018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699a7b1-3de3-49dc-925e-1d4e3d2e9157 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:32.053483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699a7b1-3de3-49dc-925e-1d4e3d2e9157 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:32.053601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699a7b1-3de3-49dc-925e-1d4e3d2e9157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:32.073963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b699a7b1-3de3-49dc-925e-1d4e3d2e9157 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:32.075142 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b699a7b1-3de3-49dc-925e-1d4e3d2e9157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:32.083300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 747/1480] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:51:32.128422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd58dc-c3ce-4a12-bbd4-f2212a39ad4c None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:32.143875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd58dc-c3ce-4a12-bbd4-f2212a39ad4c None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:32.150435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242a899-9aeb-4cbd-96b3-a5204e22c138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:32.151085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242a899-9aeb-4cbd-96b3-a5204e22c138 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:32.151365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242a899-9aeb-4cbd-96b3-a5204e22c138 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:32.151641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242a899-9aeb-4cbd-96b3-a5204e22c138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:32.160407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242a899-9aeb-4cbd-96b3-a5204e22c138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:32.162070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242a899-9aeb-4cbd-96b3-a5204e22c138 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:32.171881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 734/1481] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:51:34.560951 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7b79-4a50-41d3-ad55-b639eee44bb7 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:34.561580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7b79-4a50-41d3-ad55-b639eee44bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:34.561580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7b79-4a50-41d3-ad55-b639eee44bb7 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:34.562878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 748/1482] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:34.569350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1aceff-7288-43fe-a430-60ec962c6934 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:34.570093 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1aceff-7288-43fe-a430-60ec962c6934 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:34.570207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1aceff-7288-43fe-a430-60ec962c6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:34.594662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-1a1aceff-7288-43fe-a430-60ec962c6934 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:34.595926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1a1aceff-7288-43fe-a430-60ec962c6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:34.605277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 735/1483] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:51:34.641637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a7b79-4a50-41d3-ad55-b639eee44bb7 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:34.658638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a7b79-4a50-41d3-ad55-b639eee44bb7 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:34.663595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d692eb-3091-468f-ab69-795d458e6245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:34.664240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d692eb-3091-468f-ab69-795d458e6245 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:34.664519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d692eb-3091-468f-ab69-795d458e6245 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:34.664788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d692eb-3091-468f-ab69-795d458e6245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:34.674936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d692eb-3091-468f-ab69-795d458e6245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:34.676370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d692eb-3091-468f-ab69-795d458e6245 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:34.686036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 749/1484] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:51:36.972114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26484ea-4004-4a6c-95ea-fa687b91844d None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:36.972770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26484ea-4004-4a6c-95ea-fa687b91844d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:36.972770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26484ea-4004-4a6c-95ea-fa687b91844d None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:36.974087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 736/1485] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:36.980505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6257d-eea3-45e7-85d4-ab24159e4793 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:36.981331 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6257d-eea3-45e7-85d4-ab24159e4793 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:36.981602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6257d-eea3-45e7-85d4-ab24159e4793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:37.004861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-bea6257d-eea3-45e7-85d4-ab24159e4793 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:37.006091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-bea6257d-eea3-45e7-85d4-ab24159e4793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:37.015383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 750/1486] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:51:37.053242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26484ea-4004-4a6c-95ea-fa687b91844d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:37.066322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26484ea-4004-4a6c-95ea-fa687b91844d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:37.071377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f347d-4af6-498b-bc5d-0a24d95145cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:37.072044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f347d-4af6-498b-bc5d-0a24d95145cd service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:37.072325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f347d-4af6-498b-bc5d-0a24d95145cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:37.072590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f347d-4af6-498b-bc5d-0a24d95145cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:37.082657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f347d-4af6-498b-bc5d-0a24d95145cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:37.084085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f347d-4af6-498b-bc5d-0a24d95145cd service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:37.093543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 737/1487] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:51:39.418165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324298c-25dc-40b1-a5e8-b2e4d0d5993c None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:39.418803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324298c-25dc-40b1-a5e8-b2e4d0d5993c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:39.418803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324298c-25dc-40b1-a5e8-b2e4d0d5993c None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:39.420090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 751/1488] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:39.426576 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e35d-ca1a-4658-aefe-5c12907c97ba None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:39.427352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e35d-ca1a-4658-aefe-5c12907c97ba None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:39.427526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e35d-ca1a-4658-aefe-5c12907c97ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:39.452645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8f37e35d-ca1a-4658-aefe-5c12907c97ba None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:39.454035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8f37e35d-ca1a-4658-aefe-5c12907c97ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:39.462533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 738/1489] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:51:39.502382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324298c-25dc-40b1-a5e8-b2e4d0d5993c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:39.515188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324298c-25dc-40b1-a5e8-b2e4d0d5993c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:39.519510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb48e12-7d34-4db8-a401-18cd4cfd99ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:39.520174 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb48e12-7d34-4db8-a401-18cd4cfd99ec service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:39.520452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb48e12-7d34-4db8-a401-18cd4cfd99ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:39.520747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb48e12-7d34-4db8-a401-18cd4cfd99ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:39.532523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb48e12-7d34-4db8-a401-18cd4cfd99ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:39.534898 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb48e12-7d34-4db8-a401-18cd4cfd99ec service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:39.547042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 752/1490] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:51:41.968500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead65e0-0c8b-4564-b116-caf06bee5994 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:41.969423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead65e0-0c8b-4564-b116-caf06bee5994 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:41.969423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead65e0-0c8b-4564-b116-caf06bee5994 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:41.971125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 739/1491] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 4 18:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:51:41.977214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce8e6-0373-49b8-8077-fbc83767d7bb None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:41.977947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce8e6-0373-49b8-8077-fbc83767d7bb None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:41.977947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ce8e6-0373-49b8-8077-fbc83767d7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:41.997296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-2b6ce8e6-0373-49b8-8077-fbc83767d7bb None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:51:41.998528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-2b6ce8e6-0373-49b8-8077-fbc83767d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:51:42.010092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 753/1492] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 4 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:51:42.055185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead65e0-0c8b-4564-b116-caf06bee5994 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:51:42.068136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead65e0-0c8b-4564-b116-caf06bee5994 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:51:42.072319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0650840-02db-4d60-a0a6-118c381b6c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:51:42.072971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0650840-02db-4d60-a0a6-118c381b6c26 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:51:42.073238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0650840-02db-4d60-a0a6-118c381b6c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:51:42.073540 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0650840-02db-4d60-a0a6-118c381b6c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:51:42.083618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0650840-02db-4d60-a0a6-118c381b6c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:51:42.085104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0650840-02db-4d60-a0a6-118c381b6c26 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:51:42.094979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 740/1493] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:53:10.994334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4748d-5b79-45ee-bd05-0ae1662c97ea None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:10.994972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4748d-5b79-45ee-bd05-0ae1662c97ea None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:10.994972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4748d-5b79-45ee-bd05-0ae1662c97ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.015568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-29f4748d-5b79-45ee-bd05-0ae1662c97ea None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:11.016753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-29f4748d-5b79-45ee-bd05-0ae1662c97ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:11.026877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 754/1494] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:53:11.034799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805914e3-db91-4434-9878-a7b947b0a3df None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.035328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805914e3-db91-4434-9878-a7b947b0a3df None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.035328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805914e3-db91-4434-9878-a7b947b0a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.053780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-805914e3-db91-4434-9878-a7b947b0a3df None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:11.054945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-805914e3-db91-4434-9878-a7b947b0a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:11.063112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 741/1495] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:53:11.067688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4748d-5b79-45ee-bd05-0ae1662c97ea None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.077503 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4748d-5b79-45ee-bd05-0ae1662c97ea None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.083008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.083640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.083928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.084197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.084920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:53:11.085225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.086268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING py.warnings [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:53:11.086268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: warnings.warn(msg) May 04 18:53:11.086268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: May 04 18:53:11.087167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.098719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 755/1496] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:53:11.106828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805914e3-db91-4434-9878-a7b947b0a3df None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.115921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805914e3-db91-4434-9878-a7b947b0a3df None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.121471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b2d49-e9b1-43fe-aa7b-c3f141fa46ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.122448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b2d49-e9b1-43fe-aa7b-c3f141fa46ae admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.122722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b2d49-e9b1-43fe-aa7b-c3f141fa46ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.122990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b2d49-e9b1-43fe-aa7b-c3f141fa46ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.123699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b2d49-e9b1-43fe-aa7b-c3f141fa46ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.125526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WARNING py.warnings [None req-6f9b2d49-e9b1-43fe-aa7b-c3f141fa46ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:53:11.125526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: warnings.warn(msg) May 04 18:53:11.125526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: May 04 18:53:11.126744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b2d49-e9b1-43fe-aa7b-c3f141fa46ae admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.173358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 742/1497] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:53:11 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:11.177597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.187882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0fd23-f33e-4298-ad6c-fa830ce71c97 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.247677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b438bf-84ae-4108-942d-3cd2aec2da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.248292 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b438bf-84ae-4108-942d-3cd2aec2da1a admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.248569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b438bf-84ae-4108-942d-3cd2aec2da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.248834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b438bf-84ae-4108-942d-3cd2aec2da1a admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.249569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b438bf-84ae-4108-942d-3cd2aec2da1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.250604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING py.warnings [None req-48b438bf-84ae-4108-942d-3cd2aec2da1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:53:11.250604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: warnings.warn(msg) May 04 18:53:11.250604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: May 04 18:53:11.251844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b438bf-84ae-4108-942d-3cd2aec2da1a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.274091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 756/1498] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:53:11 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:53:11.278269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b2d49-e9b1-43fe-aa7b-c3f141fa46ae admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.288416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b2d49-e9b1-43fe-aa7b-c3f141fa46ae admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.293522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7271e6f-cdf6-495c-82a0-96f6b25f06c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.294181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7271e6f-cdf6-495c-82a0-96f6b25f06c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.294458 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7271e6f-cdf6-495c-82a0-96f6b25f06c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.294728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7271e6f-cdf6-495c-82a0-96f6b25f06c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.295481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7271e6f-cdf6-495c-82a0-96f6b25f06c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.296588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WARNING py.warnings [None req-d7271e6f-cdf6-495c-82a0-96f6b25f06c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:53:11.296588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: warnings.warn(msg) May 04 18:53:11.296588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: May 04 18:53:11.297545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7271e6f-cdf6-495c-82a0-96f6b25f06c0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.310179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 743/1499] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:53:11.314233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b438bf-84ae-4108-942d-3cd2aec2da1a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.324322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b438bf-84ae-4108-942d-3cd2aec2da1a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.329623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ee910-65ca-49e4-856d-81f3d00552e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.330298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ee910-65ca-49e4-856d-81f3d00552e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.330571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ee910-65ca-49e4-856d-81f3d00552e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.330842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ee910-65ca-49e4-856d-81f3d00552e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.331567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ee910-65ca-49e4-856d-81f3d00552e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.332558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING py.warnings [None req-df2ee910-65ca-49e4-856d-81f3d00552e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:53:11.332558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: warnings.warn(msg) May 04 18:53:11.332558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: May 04 18:53:11.333485 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ee910-65ca-49e4-856d-81f3d00552e6 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.347567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 757/1500] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:53:11.351887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7271e6f-cdf6-495c-82a0-96f6b25f06c0 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.361750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7271e6f-cdf6-495c-82a0-96f6b25f06c0 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.366992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804502-62d0-4afa-b7eb-bbba53355b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.368342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804502-62d0-4afa-b7eb-bbba53355b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.368702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804502-62d0-4afa-b7eb-bbba53355b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.368970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804502-62d0-4afa-b7eb-bbba53355b03 admin admin] PATH_INFO: `/v3/projects/36f6f7c731094d49a5c5268e4ea31762/users/9e5178ab31a247939d673efcd10a4a66/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.384209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804502-62d0-4afa-b7eb-bbba53355b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f6f7c731094d49a5c5268e4ea31762, user_id=9e5178ab31a247939d673efcd10a4a66, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.385266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WARNING py.warnings [None req-4f804502-62d0-4afa-b7eb-bbba53355b03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:53:11.385266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: warnings.warn(msg) May 04 18:53:11.385266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: May 04 18:53:11.387274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804502-62d0-4afa-b7eb-bbba53355b03 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.401675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 744/1501] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:53:11 2022] PUT /identity/v3/projects/36f6f7c731094d49a5c5268e4ea31762/users/9e5178ab31a247939d673efcd10a4a66/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:53:11.413115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6bb95-1624-4aac-b35b-8559b4b61497 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.413443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6bb95-1624-4aac-b35b-8559b4b61497 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.413725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6bb95-1624-4aac-b35b-8559b4b61497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.439923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-75d6bb95-1624-4aac-b35b-8559b4b61497 None None] MFA Rules not processed for user `9e5178ab31a247939d673efcd10a4a66`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:11.441099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-75d6bb95-1624-4aac-b35b-8559b4b61497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:11.510488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 758/1502] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:53:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:53:11.521753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804502-62d0-4afa-b7eb-bbba53355b03 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.597981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804502-62d0-4afa-b7eb-bbba53355b03 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.604362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428718f6-d53c-4afb-8cbe-96dc97b21a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.605005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428718f6-d53c-4afb-8cbe-96dc97b21a0c service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.605317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428718f6-d53c-4afb-8cbe-96dc97b21a0c service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.605590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428718f6-d53c-4afb-8cbe-96dc97b21a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.613528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428718f6-d53c-4afb-8cbe-96dc97b21a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.615115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428718f6-d53c-4afb-8cbe-96dc97b21a0c service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.624098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 745/1503] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:53:11.697211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04252b82-2ece-4561-af94-8e619f0d9787 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.697551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04252b82-2ece-4561-af94-8e619f0d9787 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.697839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04252b82-2ece-4561-af94-8e619f0d9787 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.699121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 759/1504] 10.222.0.35 () {52 vars in 829 bytes} [Wed May 4 18:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:53:11.702821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428718f6-d53c-4afb-8cbe-96dc97b21a0c service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.764187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428718f6-d53c-4afb-8cbe-96dc97b21a0c service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:11.769740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:11.770617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.770893 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.771166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] PATH_INFO: `/v3/users/9e5178ab31a247939d673efcd10a4a66` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.772466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5178ab31a247939d673efcd10a4a66)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:11.773511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WARNING py.warnings [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:53:11.773511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: warnings.warn(msg) May 04 18:53:11.773511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: May 04 18:53:11.774746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:11.843267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5178ab31a247939d673efcd10a4a66'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:11.856441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5178ab31a247939d673efcd10a4a66'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:11.857191 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5178ab31a247939d673efcd10a4a66'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:11.858021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5178ab31a247939d673efcd10a4a66'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:11.870843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5178ab31a247939d673efcd10a4a66'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:11.896316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 746/1505] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:53:11 2022] DELETE /identity/v3/users/9e5178ab31a247939d673efcd10a4a66 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:53:11.900923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4991b-746d-4678-acba-b0c0d086e153 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:11.901238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4991b-746d-4678-acba-b0c0d086e153 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:11.901580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4991b-746d-4678-acba-b0c0d086e153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:11.919493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-07c4991b-746d-4678-acba-b0c0d086e153 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:53:11.920688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-07c4991b-746d-4678-acba-b0c0d086e153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:11.978273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 760/1506] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:53:11.989348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:11.991323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:12.062932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562bc9a-48ec-4b59-84c3-00b834faa9dd admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:12.067587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e19c1-cdfe-4a99-a95a-cec8157b7fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:12.068251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e19c1-cdfe-4a99-a95a-cec8157b7fac service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:12.068534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e19c1-cdfe-4a99-a95a-cec8157b7fac service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:12.068805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e19c1-cdfe-4a99-a95a-cec8157b7fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:12.078141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e19c1-cdfe-4a99-a95a-cec8157b7fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:12.079585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e19c1-cdfe-4a99-a95a-cec8157b7fac service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:12.088893 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 747/1507] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:53:12.417839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4991b-746d-4678-acba-b0c0d086e153 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:53:12.419309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-07c4991b-746d-4678-acba-b0c0d086e153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:53:12.431466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4991b-746d-4678-acba-b0c0d086e153 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:53:12.436909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:53:12.437892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:53:12.438235 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:53:12.438630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] PATH_INFO: `/v3/projects/36f6f7c731094d49a5c5268e4ea31762` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:53:12.440136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f6f7c731094d49a5c5268e4ea31762)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:53:12.441382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING py.warnings [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:53:12.441382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: warnings.warn(msg) May 04 18:53:12.441382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: May 04 18:53:12.442592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:53:12.504300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f6f7c731094d49a5c5268e4ea31762', 'request_id': 'req-a6c3b076-c10a-402b-8de2-34e096a52bc6'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:12.516486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f6f7c731094d49a5c5268e4ea31762', 'request_id': 'req-a6c3b076-c10a-402b-8de2-34e096a52bc6'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:12.529800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f6f7c731094d49a5c5268e4ea31762', 'request_id': 'req-a6c3b076-c10a-402b-8de2-34e096a52bc6'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:12.540781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] The token cache is being invalidate because project 36f6f7c731094d49a5c5268e4ea31762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:53:12.541060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:12.541787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a6c3b076-c10a-402b-8de2-34e096a52bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:53:12.543466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 761/1508] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:53:12 2022] DELETE /identity/v3/projects/36f6f7c731094d49a5c5268e4ea31762 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:54:50.398675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb88444-1f8d-49ba-9196-8b6ae21f329a None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:50.399307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb88444-1f8d-49ba-9196-8b6ae21f329a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:50.399307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb88444-1f8d-49ba-9196-8b6ae21f329a None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:50.401356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 748/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:54:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:50.406553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45df47c-9742-4db3-8860-50f4b19442a5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:50.406987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45df47c-9742-4db3-8860-50f4b19442a5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:50.407091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45df47c-9742-4db3-8860-50f4b19442a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:50.425676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c45df47c-9742-4db3-8860-50f4b19442a5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:50.426860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c45df47c-9742-4db3-8860-50f4b19442a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:50.486676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 762/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:54:50.642535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb88444-1f8d-49ba-9196-8b6ae21f329a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:50.645738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ecb88444-1f8d-49ba-9196-8b6ae21f329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:50.743158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb88444-1f8d-49ba-9196-8b6ae21f329a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:50.750383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faca1f-a4f4-4b32-b145-57b3ab7ab965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:50.751059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faca1f-a4f4-4b32-b145-57b3ab7ab965 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:50.751339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faca1f-a4f4-4b32-b145-57b3ab7ab965 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:50.751611 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faca1f-a4f4-4b32-b145-57b3ab7ab965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:50.759955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faca1f-a4f4-4b32-b145-57b3ab7ab965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:50.761599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faca1f-a4f4-4b32-b145-57b3ab7ab965 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:50.776160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 749/1511] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:54:51.117050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0bbbd-d018-436c-9b69-d5e0e83289d2 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:51.117346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0bbbd-d018-436c-9b69-d5e0e83289d2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:51.117665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0bbbd-d018-436c-9b69-d5e0e83289d2 None None] PATH_INFO: `/v3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:51.118978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 763/1512] 10.222.0.55 () {54 vars in 925 bytes} [Wed May 4 18:54:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:54:51.125712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417678a-51b0-4a33-8699-6149448ae3cb None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:51.125973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417678a-51b0-4a33-8699-6149448ae3cb None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:51.126272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417678a-51b0-4a33-8699-6149448ae3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:51.151185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3417678a-51b0-4a33-8699-6149448ae3cb None None] MFA Rules not processed for user `f6eaf63f68734bdd938aa0ea7d0c4441`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:51.151185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3417678a-51b0-4a33-8699-6149448ae3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:51.218833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 750/1513] 10.222.0.55 () {58 vars in 1015 bytes} [Wed May 4 18:54:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:54:52.000931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e137-37e2-43e2-96fd-de496eb290b7 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:52.001949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e137-37e2-43e2-96fd-de496eb290b7 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:52.002312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e137-37e2-43e2-96fd-de496eb290b7 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:52.005081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:54:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:52.010215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a50068-82bf-4929-9372-f71dd37fe106 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:52.010678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a50068-82bf-4929-9372-f71dd37fe106 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:52.010789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a50068-82bf-4929-9372-f71dd37fe106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:52.028856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-82a50068-82bf-4929-9372-f71dd37fe106 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:52.030087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-82a50068-82bf-4929-9372-f71dd37fe106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:52.038040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:54:52.188478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0e137-37e2-43e2-96fd-de496eb290b7 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:52.204765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0e137-37e2-43e2-96fd-de496eb290b7 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:52.211117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3f8ae-4be9-4a3c-b258-b9c5b7ed5346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:52.211750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f8ae-4be9-4a3c-b258-b9c5b7ed5346 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:52.212030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f8ae-4be9-4a3c-b258-b9c5b7ed5346 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:52.212301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f8ae-4be9-4a3c-b258-b9c5b7ed5346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:52.220496 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3f8ae-4be9-4a3c-b258-b9c5b7ed5346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:52.222136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3f8ae-4be9-4a3c-b258-b9c5b7ed5346 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:52.231353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 765/1516] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:54:55.116009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cd768-c3e0-42f7-8bb7-8e8bf8379742 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:55.116901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cd768-c3e0-42f7-8bb7-8e8bf8379742 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:55.116901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cd768-c3e0-42f7-8bb7-8e8bf8379742 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:55.119157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 752/1517] 10.222.0.35 () {54 vars in 960 bytes} [Wed May 4 18:54:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:54:55.124732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9fef-8a32-4343-8148-242d678de60b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:55.125191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9fef-8a32-4343-8148-242d678de60b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:55.125312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9fef-8a32-4343-8148-242d678de60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:55.146586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3a7f9fef-8a32-4343-8148-242d678de60b None None] MFA Rules not processed for user `f6eaf63f68734bdd938aa0ea7d0c4441`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:54:55.148157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3a7f9fef-8a32-4343-8148-242d678de60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:54:55.157359 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 766/1518] 10.222.0.35 () {58 vars in 1057 bytes} [Wed May 4 18:54:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:54:55.165080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cd768-c3e0-42f7-8bb7-8e8bf8379742 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:54:55.179043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cd768-c3e0-42f7-8bb7-8e8bf8379742 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:54:55.184000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa07c5b-7a7e-400d-90be-d32cc3406801 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6eaf63f68734bdd938aa0ea7d0c4441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:54:55.184646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa07c5b-7a7e-400d-90be-d32cc3406801 service placement] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:54:55.184929 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa07c5b-7a7e-400d-90be-d32cc3406801 service placement] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:54:55.185200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa07c5b-7a7e-400d-90be-d32cc3406801 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:54:55.193230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa07c5b-7a7e-400d-90be-d32cc3406801 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:54:55.194834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa07c5b-7a7e-400d-90be-d32cc3406801 service placement] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:54:55.204061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 753/1519] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:54:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:55:03.891874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307fbb-b353-4b1e-b3c2-3a6ee9554777 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:03.892722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307fbb-b353-4b1e-b3c2-3a6ee9554777 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:03.892722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307fbb-b353-4b1e-b3c2-3a6ee9554777 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:03.895055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 767/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:55:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:03.902932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac476-df91-47b6-827c-4793a58ee42c None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:03.903361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac476-df91-47b6-827c-4793a58ee42c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:03.903475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac476-df91-47b6-827c-4793a58ee42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:03.925775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-624ac476-df91-47b6-827c-4793a58ee42c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:03.926959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-624ac476-df91-47b6-827c-4793a58ee42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:03.935793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 754/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:55:04.085347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307fbb-b353-4b1e-b3c2-3a6ee9554777 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:04.106355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307fbb-b353-4b1e-b3c2-3a6ee9554777 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:04.112509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b02ca-eeae-4398-969f-926d26f87dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:04.113184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b02ca-eeae-4398-969f-926d26f87dd1 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:04.113493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b02ca-eeae-4398-969f-926d26f87dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:04.113787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b02ca-eeae-4398-969f-926d26f87dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:04.123605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b02ca-eeae-4398-969f-926d26f87dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:04.125224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b02ca-eeae-4398-969f-926d26f87dd1 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:04.135623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 768/1522] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:55:05.349685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac85c12-071b-473d-8121-158c7e1ba164 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:05.350306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac85c12-071b-473d-8121-158c7e1ba164 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:05.350306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac85c12-071b-473d-8121-158c7e1ba164 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:05.351642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 755/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 18:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:05.357656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ca039-bd5a-41c4-8af4-995b0025d7f6 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:05.358100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ca039-bd5a-41c4-8af4-995b0025d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:05.358213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ca039-bd5a-41c4-8af4-995b0025d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:05.390008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-981ca039-bd5a-41c4-8af4-995b0025d7f6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:05.391229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-981ca039-bd5a-41c4-8af4-995b0025d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:05.404973 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 769/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 18:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:55:05.558728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac85c12-071b-473d-8121-158c7e1ba164 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:05.579272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac85c12-071b-473d-8121-158c7e1ba164 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:05.585873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747c71-56ba-4b5b-aab6-3cef8eb22f74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:05.586524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747c71-56ba-4b5b-aab6-3cef8eb22f74 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:05.586804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747c71-56ba-4b5b-aab6-3cef8eb22f74 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:05.587077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747c71-56ba-4b5b-aab6-3cef8eb22f74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:05.596059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40747c71-56ba-4b5b-aab6-3cef8eb22f74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:05.597692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40747c71-56ba-4b5b-aab6-3cef8eb22f74 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:05.607199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 756/1525] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:55:09.698058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8972b-e6f6-450b-9588-e9f903a17762 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:09.698614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8972b-e6f6-450b-9588-e9f903a17762 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:09.698614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8972b-e6f6-450b-9588-e9f903a17762 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:09.700752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 770/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:55:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:09.709380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb141c-fb91-4d87-b795-3a3780259c7a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:09.709793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb141c-fb91-4d87-b795-3a3780259c7a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:09.709887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb141c-fb91-4d87-b795-3a3780259c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:09.728912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3abb141c-fb91-4d87-b795-3a3780259c7a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:09.730127 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3abb141c-fb91-4d87-b795-3a3780259c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:09.739369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 757/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:55:09.775923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8972b-e6f6-450b-9588-e9f903a17762 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:09.777992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-69b8972b-e6f6-450b-9588-e9f903a17762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:09.837661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8972b-e6f6-450b-9588-e9f903a17762 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:09.841310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986963f-fc83-4fe3-b4cd-8c7c4ed47a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:09.842041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986963f-fc83-4fe3-b4cd-8c7c4ed47a59 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:09.842239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986963f-fc83-4fe3-b4cd-8c7c4ed47a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:09.842514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986963f-fc83-4fe3-b4cd-8c7c4ed47a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:09.852142 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986963f-fc83-4fe3-b4cd-8c7c4ed47a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:09.853700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986963f-fc83-4fe3-b4cd-8c7c4ed47a59 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:09.863026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 771/1528] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:55:12.078056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be561da-af33-4823-a085-4155c819ff8a None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:12.078732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be561da-af33-4823-a085-4155c819ff8a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:12.078732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be561da-af33-4823-a085-4155c819ff8a None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:12.079980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 758/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:12.086445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1078c7-fe57-4c88-ab23-ed3bc4b61666 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:12.087175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1078c7-fe57-4c88-ab23-ed3bc4b61666 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:12.087357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1078c7-fe57-4c88-ab23-ed3bc4b61666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:12.111595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-cb1078c7-fe57-4c88-ab23-ed3bc4b61666 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:12.112829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cb1078c7-fe57-4c88-ab23-ed3bc4b61666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:12.123657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 772/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:55:12.158986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be561da-af33-4823-a085-4155c819ff8a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:12.160798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1be561da-af33-4823-a085-4155c819ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:12.176322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be561da-af33-4823-a085-4155c819ff8a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:12.181317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d004e-62d5-4197-8d98-2cc53c0ff905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:12.181977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d004e-62d5-4197-8d98-2cc53c0ff905 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:12.182254 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d004e-62d5-4197-8d98-2cc53c0ff905 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:12.182521 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d004e-62d5-4197-8d98-2cc53c0ff905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:12.193182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d004e-62d5-4197-8d98-2cc53c0ff905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:12.194644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d004e-62d5-4197-8d98-2cc53c0ff905 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:12.203929 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 759/1531] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:55:15.989917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c82d5-837c-480a-b1e1-b72ed8399ff7 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:15.990536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c82d5-837c-480a-b1e1-b72ed8399ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:15.990536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c82d5-837c-480a-b1e1-b72ed8399ff7 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:15.991928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 773/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:15.998556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb2ba-7eeb-4f47-be64-6b9af3525d5f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:15.999041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb2ba-7eeb-4f47-be64-6b9af3525d5f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:15.999303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb2ba-7eeb-4f47-be64-6b9af3525d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:16.026606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-b94fb2ba-7eeb-4f47-be64-6b9af3525d5f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:16.027720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b94fb2ba-7eeb-4f47-be64-6b9af3525d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:16.036383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 760/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:55:16.302100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c82d5-837c-480a-b1e1-b72ed8399ff7 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:16.304088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-738c82d5-837c-480a-b1e1-b72ed8399ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:16.364038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c82d5-837c-480a-b1e1-b72ed8399ff7 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:16.368525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489d9ad-a76f-4336-a365-edca2d8e8353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:16.369173 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489d9ad-a76f-4336-a365-edca2d8e8353 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:16.369489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489d9ad-a76f-4336-a365-edca2d8e8353 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:16.369776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489d9ad-a76f-4336-a365-edca2d8e8353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:16.380351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489d9ad-a76f-4336-a365-edca2d8e8353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:16.381816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489d9ad-a76f-4336-a365-edca2d8e8353 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:16.391490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 774/1534] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:55:18.663736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028a893-cac3-4922-b105-b86a34ec6648 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:18.664346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028a893-cac3-4922-b105-b86a34ec6648 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:18.664346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028a893-cac3-4922-b105-b86a34ec6648 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:18.665726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 761/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 18:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:18.672048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c61538-91bd-4041-8909-24561e3dbf83 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:18.672899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c61538-91bd-4041-8909-24561e3dbf83 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:18.672899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c61538-91bd-4041-8909-24561e3dbf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:18.695990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e2c61538-91bd-4041-8909-24561e3dbf83 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:18.697179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e2c61538-91bd-4041-8909-24561e3dbf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:18.705845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 775/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 18:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:55:18.972639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838983-d352-4dd8-82de-59d753eda015 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:18.972931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838983-d352-4dd8-82de-59d753eda015 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:18.973206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838983-d352-4dd8-82de-59d753eda015 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:18.974627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 762/1537] 10.222.0.35 () {54 vars in 963 bytes} [Wed May 4 18:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:55:18.980760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861999-5f5d-4a1e-a6bb-d1e255d74e68 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:18.981231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861999-5f5d-4a1e-a6bb-d1e255d74e68 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:18.981672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861999-5f5d-4a1e-a6bb-d1e255d74e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:19.006200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-06861999-5f5d-4a1e-a6bb-d1e255d74e68 None None] MFA Rules not processed for user `432759ff503942e7ae6941f9d4b951b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:55:19.007436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-06861999-5f5d-4a1e-a6bb-d1e255d74e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:55:19.015022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 776/1538] 10.222.0.35 () {58 vars in 1060 bytes} [Wed May 4 18:55:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:55:19.023077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94838983-d352-4dd8-82de-59d753eda015 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:55:19.035299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94838983-d352-4dd8-82de-59d753eda015 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:55:19.039297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcccdc-4e06-4c89-a648-44a9ee8a2280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:55:19.039937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcccdc-4e06-4c89-a648-44a9ee8a2280 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:55:19.040222 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcccdc-4e06-4c89-a648-44a9ee8a2280 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:55:19.040499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcccdc-4e06-4c89-a648-44a9ee8a2280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:55:19.050567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcccdc-4e06-4c89-a648-44a9ee8a2280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:55:19.052749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcccdc-4e06-4c89-a648-44a9ee8a2280 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:55:19.063109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 763/1539] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:48.630167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5575a-69b5-48ef-8875-d102ae1cc3d0 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:48.630803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5575a-69b5-48ef-8875-d102ae1cc3d0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:48.630803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5575a-69b5-48ef-8875-d102ae1cc3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:48.658120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3be5575a-69b5-48ef-8875-d102ae1cc3d0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:48.659734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3be5575a-69b5-48ef-8875-d102ae1cc3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:48.670156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 777/1540] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:48.680969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805b7bc-88dd-4bee-8cd3-ade8f5200141 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:48.681559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805b7bc-88dd-4bee-8cd3-ade8f5200141 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:48.681559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805b7bc-88dd-4bee-8cd3-ade8f5200141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:48.709888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-b805b7bc-88dd-4bee-8cd3-ade8f5200141 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:48.710988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b805b7bc-88dd-4bee-8cd3-ade8f5200141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:48.727776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 764/1541] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:48.733158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5575a-69b5-48ef-8875-d102ae1cc3d0 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:48.748225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5575a-69b5-48ef-8875-d102ae1cc3d0 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:48.759236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f0f9b-59d2-41ef-b385-607e1ca8e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:48.760312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0f9b-59d2-41ef-b385-607e1ca8e37f admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:48.760819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0f9b-59d2-41ef-b385-607e1ca8e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:48.761399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0f9b-59d2-41ef-b385-607e1ca8e37f admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:48.762393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f0f9b-59d2-41ef-b385-607e1ca8e37f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:48.762915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f0f9b-59d2-41ef-b385-607e1ca8e37f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:48.764801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f0f9b-59d2-41ef-b385-607e1ca8e37f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:48.775404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4f8df-f2f7-4a1c-b455-cef750c3ca75 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:48.776049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4f8df-f2f7-4a1c-b455-cef750c3ca75 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:48.777082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4f8df-f2f7-4a1c-b455-cef750c3ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:48.785463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 778/1542] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:48.787977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f0f9b-59d2-41ef-b385-607e1ca8e37f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:48.801470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f0f9b-59d2-41ef-b385-607e1ca8e37f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:48.806248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-02e4f8df-f2f7-4a1c-b455-cef750c3ca75 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:48.808319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-02e4f8df-f2f7-4a1c-b455-cef750c3ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:48.820362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 765/1543] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:56:48.821754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8693f-4469-4fed-91f1-0d1220afb0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:48.822452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8693f-4469-4fed-91f1-0d1220afb0df admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:48.822747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8693f-4469-4fed-91f1-0d1220afb0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:48.823007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8693f-4469-4fed-91f1-0d1220afb0df admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:48.823335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780fde5-0a12-47a9-8fd2-6b279dba7a69 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:48.823771 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8693f-4469-4fed-91f1-0d1220afb0df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:48.824091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780fde5-0a12-47a9-8fd2-6b279dba7a69 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:48.824571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780fde5-0a12-47a9-8fd2-6b279dba7a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:48.824793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING py.warnings [None req-dee8693f-4469-4fed-91f1-0d1220afb0df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:56:48.824793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: warnings.warn(msg) May 04 18:56:48.824793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: May 04 18:56:48.826069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8693f-4469-4fed-91f1-0d1220afb0df admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:48.864244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-b780fde5-0a12-47a9-8fd2-6b279dba7a69 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:48.865482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b780fde5-0a12-47a9-8fd2-6b279dba7a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:48.882323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 766/1544] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:48.891666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfb959-407b-409f-9645-cb90fefea72f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:48.892294 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfb959-407b-409f-9645-cb90fefea72f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:48.892784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfb959-407b-409f-9645-cb90fefea72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:48.893093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 779/1545] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:48 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:56:48.896504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebca52-e89c-460d-90e6-054dc8661772 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:48.896504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebca52-e89c-460d-90e6-054dc8661772 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:48.896504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebca52-e89c-460d-90e6-054dc8661772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:48.922482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3cbfb959-407b-409f-9645-cb90fefea72f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:48.924657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3cbfb959-407b-409f-9645-cb90fefea72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:48.930492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-1cebca52-e89c-460d-90e6-054dc8661772 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:48.930492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1cebca52-e89c-460d-90e6-054dc8661772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.030024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 780/1546] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.031366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebca52-e89c-460d-90e6-054dc8661772 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.049452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebca52-e89c-460d-90e6-054dc8661772 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.060811 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877603a-e229-40ef-94ca-d182e7cdff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.061548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877603a-e229-40ef-94ca-d182e7cdff5f admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.064946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877603a-e229-40ef-94ca-d182e7cdff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.064946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877603a-e229-40ef-94ca-d182e7cdff5f admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.065625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877603a-e229-40ef-94ca-d182e7cdff5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.071193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877603a-e229-40ef-94ca-d182e7cdff5f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.092569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 767/1547] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.096183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461773f-a857-4bf5-87b4-2abf1f2f2581 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.096183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461773f-a857-4bf5-87b4-2abf1f2f2581 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.096183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461773f-a857-4bf5-87b4-2abf1f2f2581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.127200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 781/1548] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.128410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877603a-e229-40ef-94ca-d182e7cdff5f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.144530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9461773f-a857-4bf5-87b4-2abf1f2f2581 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.145775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9461773f-a857-4bf5-87b4-2abf1f2f2581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.146289 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877603a-e229-40ef-94ca-d182e7cdff5f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.158185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e37d18-f35c-412b-8215-75cb00988774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.159210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e37d18-f35c-412b-8215-75cb00988774 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.159715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e37d18-f35c-412b-8215-75cb00988774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.160202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e37d18-f35c-412b-8215-75cb00988774 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.161071 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 768/1549] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.161732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e37d18-f35c-412b-8215-75cb00988774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:49.162153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461773f-a857-4bf5-87b4-2abf1f2f2581 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.162539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e37d18-f35c-412b-8215-75cb00988774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.164377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e37d18-f35c-412b-8215-75cb00988774 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.182842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461773f-a857-4bf5-87b4-2abf1f2f2581 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.185740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 782/1550] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:49.186594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e37d18-f35c-412b-8215-75cb00988774 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.196345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3acece-8cbe-47bf-8024-5bcf432a34b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.197035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3acece-8cbe-47bf-8024-5bcf432a34b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.197333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3acece-8cbe-47bf-8024-5bcf432a34b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.197609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3acece-8cbe-47bf-8024-5bcf432a34b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.197785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e37d18-f35c-412b-8215-75cb00988774 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.198347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3acece-8cbe-47bf-8024-5bcf432a34b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:49.198920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3acece-8cbe-47bf-8024-5bcf432a34b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.199925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WARNING py.warnings [None req-7b3acece-8cbe-47bf-8024-5bcf432a34b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:56:49.199925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: warnings.warn(msg) May 04 18:56:49.199925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: May 04 18:56:49.200850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3acece-8cbe-47bf-8024-5bcf432a34b4 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.202753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673e7ff-c4e3-4b1e-8567-bc0291e4c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.203420 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673e7ff-c4e3-4b1e-8567-bc0291e4c33a admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.203701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673e7ff-c4e3-4b1e-8567-bc0291e4c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.203978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673e7ff-c4e3-4b1e-8567-bc0291e4c33a admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.204712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673e7ff-c4e3-4b1e-8567-bc0291e4c33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.206535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673e7ff-c4e3-4b1e-8567-bc0291e4c33a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.215950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 769/1551] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:49.217249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39036-1ee0-4a96-8805-62648263783f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.217567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39036-1ee0-4a96-8805-62648263783f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.217839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39036-1ee0-4a96-8805-62648263783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.222103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 783/1552] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:49.225528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531e2ba-9d1e-4e0f-9ce2-817d94f8b5bf None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.225528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531e2ba-9d1e-4e0f-9ce2-817d94f8b5bf None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.225528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531e2ba-9d1e-4e0f-9ce2-817d94f8b5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.238068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-2df39036-1ee0-4a96-8805-62648263783f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.239277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2df39036-1ee0-4a96-8805-62648263783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.247687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 770/1553] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.249022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f301-d901-4780-8510-f21e60505f7b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.249353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-4531e2ba-9d1e-4e0f-9ce2-817d94f8b5bf None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.249530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f301-d901-4780-8510-f21e60505f7b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.249902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f301-d901-4780-8510-f21e60505f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.250539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4531e2ba-9d1e-4e0f-9ce2-817d94f8b5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.258319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 784/1554] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.259676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ddbf8-129b-434c-aa1a-f0fb87c44cd4 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.259964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ddbf8-129b-434c-aa1a-f0fb87c44cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.260237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ddbf8-129b-434c-aa1a-f0fb87c44cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.274997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0f01f301-d901-4780-8510-f21e60505f7b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.276231 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0f01f301-d901-4780-8510-f21e60505f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.278182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e69ddbf8-129b-434c-aa1a-f0fb87c44cd4 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.279332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e69ddbf8-129b-434c-aa1a-f0fb87c44cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.284045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 771/1555] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.287413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 785/1556] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.288054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ddbf8-129b-434c-aa1a-f0fb87c44cd4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.290153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f301-d901-4780-8510-f21e60505f7b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.297731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ddbf8-129b-434c-aa1a-f0fb87c44cd4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.300165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f301-d901-4780-8510-f21e60505f7b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.302202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dab2af-3921-463f-83b4-2255d685de10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.302868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab2af-3921-463f-83b4-2255d685de10 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.303147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab2af-3921-463f-83b4-2255d685de10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.303418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab2af-3921-463f-83b4-2255d685de10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.304140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab2af-3921-463f-83b4-2255d685de10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.304764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc535-47b8-4737-8b58-2cc549a8e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.305455 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc535-47b8-4737-8b58-2cc549a8e78c admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.305741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc535-47b8-4737-8b58-2cc549a8e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.305843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab2af-3921-463f-83b4-2255d685de10 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.306011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc535-47b8-4737-8b58-2cc549a8e78c admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.306696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cc535-47b8-4737-8b58-2cc549a8e78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.308811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cc535-47b8-4737-8b58-2cc549a8e78c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.315564 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 786/1557] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:49.316321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dab2af-3921-463f-83b4-2255d685de10 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.325657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dab2af-3921-463f-83b4-2255d685de10 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.330255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429efd3-1128-4583-8609-281a6851ecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.330885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429efd3-1128-4583-8609-281a6851ecc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.331157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429efd3-1128-4583-8609-281a6851ecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.331428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429efd3-1128-4583-8609-281a6851ecc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.332100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429efd3-1128-4583-8609-281a6851ecc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.334019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429efd3-1128-4583-8609-281a6851ecc0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.335307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 772/1558] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.336587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e1a65-7f2f-49e3-851d-4268a2fe925e None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.336875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e1a65-7f2f-49e3-851d-4268a2fe925e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.337156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e1a65-7f2f-49e3-851d-4268a2fe925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.354760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c78e1a65-7f2f-49e3-851d-4268a2fe925e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.356353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c78e1a65-7f2f-49e3-851d-4268a2fe925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.361617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 787/1559] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.362436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429efd3-1128-4583-8609-281a6851ecc0 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.419269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 773/1560] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.420583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71639358-e82b-4cae-9751-9fe3335b3580 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.420993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71639358-e82b-4cae-9751-9fe3335b3580 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.421275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71639358-e82b-4cae-9751-9fe3335b3580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.426682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429efd3-1128-4583-8609-281a6851ecc0 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.431451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55717b-e133-4432-89ca-873dbbda0b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.432108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55717b-e133-4432-89ca-873dbbda0b4b admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.432385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55717b-e133-4432-89ca-873dbbda0b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.432708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55717b-e133-4432-89ca-873dbbda0b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.433618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55717b-e133-4432-89ca-873dbbda0b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:49.433919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55717b-e133-4432-89ca-873dbbda0b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.435526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55717b-e133-4432-89ca-873dbbda0b4b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.439178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-71639358-e82b-4cae-9751-9fe3335b3580 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.442933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-71639358-e82b-4cae-9751-9fe3335b3580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.448467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 774/1561] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.449557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 788/1562] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:49.449690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e533ad4-57bf-4c09-bd3e-734b9b2441dd None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.449931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e533ad4-57bf-4c09-bd3e-734b9b2441dd None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.450206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e533ad4-57bf-4c09-bd3e-734b9b2441dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.451645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835cdb1-0031-4139-b9fc-4361abccb6fb None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.452202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835cdb1-0031-4139-b9fc-4361abccb6fb None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.452674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835cdb1-0031-4139-b9fc-4361abccb6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.471120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-8835cdb1-0031-4139-b9fc-4361abccb6fb None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.471729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0e533ad4-57bf-4c09-bd3e-734b9b2441dd None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.472329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8835cdb1-0031-4139-b9fc-4361abccb6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.472879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0e533ad4-57bf-4c09-bd3e-734b9b2441dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.480536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 775/1563] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.480855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 789/1564] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.481268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e533ad4-57bf-4c09-bd3e-734b9b2441dd None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.481911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835cdb1-0031-4139-b9fc-4361abccb6fb None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.491236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835cdb1-0031-4139-b9fc-4361abccb6fb None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.493036 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e533ad4-57bf-4c09-bd3e-734b9b2441dd None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.496213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bcd01-38fb-42b5-a9f1-985766faa378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.496876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bcd01-38fb-42b5-a9f1-985766faa378 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.497181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bcd01-38fb-42b5-a9f1-985766faa378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.497639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bcd01-38fb-42b5-a9f1-985766faa378 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.498006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68950b-f44b-4beb-8462-087187f0d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.498319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bcd01-38fb-42b5-a9f1-985766faa378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.498884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68950b-f44b-4beb-8462-087187f0d19e admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.499164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68950b-f44b-4beb-8462-087187f0d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.499438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68950b-f44b-4beb-8462-087187f0d19e admin admin] PATH_INFO: `/v3/projects/625af698d5ee489d92da3d75516477cb/users/66b7e19a875c48069bec426b1b2efa7c/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.500255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bcd01-38fb-42b5-a9f1-985766faa378 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.514774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68950b-f44b-4beb-8462-087187f0d19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=625af698d5ee489d92da3d75516477cb, user_id=66b7e19a875c48069bec426b1b2efa7c, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.518141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68950b-f44b-4beb-8462-087187f0d19e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.521697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 790/1565] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.522556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bcd01-38fb-42b5-a9f1-985766faa378 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.532614 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 776/1566] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:49 2022] PUT /identity/v3/projects/625af698d5ee489d92da3d75516477cb/users/66b7e19a875c48069bec426b1b2efa7c/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:49.533303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bcd01-38fb-42b5-a9f1-985766faa378 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.533985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ca56-c5c7-470d-8169-b78e92529605 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.534354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ca56-c5c7-470d-8169-b78e92529605 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.534674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0ca56-c5c7-470d-8169-b78e92529605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.551571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-efc0ca56-c5c7-470d-8169-b78e92529605 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.552758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-efc0ca56-c5c7-470d-8169-b78e92529605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.588225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e5de-2707-47ec-9ba3-be12c6556a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.588900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e5de-2707-47ec-9ba3-be12c6556a13 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.589237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e5de-2707-47ec-9ba3-be12c6556a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.589540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e5de-2707-47ec-9ba3-be12c6556a13 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.590225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73e5de-2707-47ec-9ba3-be12c6556a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.592132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73e5de-2707-47ec-9ba3-be12c6556a13 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.608597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 777/1567] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.609787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0ca56-c5c7-470d-8169-b78e92529605 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.612923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 791/1568] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.613744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e5de-2707-47ec-9ba3-be12c6556a13 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.621722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0ca56-c5c7-470d-8169-b78e92529605 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.623726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e5de-2707-47ec-9ba3-be12c6556a13 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.626287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202b9c3-77bc-4bd3-8f86-f08c6d1608ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.626936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b9c3-77bc-4bd3-8f86-f08c6d1608ae admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.627214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b9c3-77bc-4bd3-8f86-f08c6d1608ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.627481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b9c3-77bc-4bd3-8f86-f08c6d1608ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.628292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202b9c3-77bc-4bd3-8f86-f08c6d1608ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:49.628595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202b9c3-77bc-4bd3-8f86-f08c6d1608ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.628711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9549fa8-41b2-48a2-b448-e335bc2d05e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.629349 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9549fa8-41b2-48a2-b448-e335bc2d05e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.629629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9549fa8-41b2-48a2-b448-e335bc2d05e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.629895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9549fa8-41b2-48a2-b448-e335bc2d05e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.630193 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202b9c3-77bc-4bd3-8f86-f08c6d1608ae admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.630749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9549fa8-41b2-48a2-b448-e335bc2d05e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.632621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9549fa8-41b2-48a2-b448-e335bc2d05e8 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.641581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 778/1569] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:49.642360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202b9c3-77bc-4bd3-8f86-f08c6d1608ae admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.651987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202b9c3-77bc-4bd3-8f86-f08c6d1608ae admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.656643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595bc6a-7a65-4c96-a3bf-a2074ef79cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.657314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595bc6a-7a65-4c96-a3bf-a2074ef79cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.657599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595bc6a-7a65-4c96-a3bf-a2074ef79cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.657879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595bc6a-7a65-4c96-a3bf-a2074ef79cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.658848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595bc6a-7a65-4c96-a3bf-a2074ef79cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:49.659164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595bc6a-7a65-4c96-a3bf-a2074ef79cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.660735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595bc6a-7a65-4c96-a3bf-a2074ef79cbc admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.661568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 792/1570] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.662369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9549fa8-41b2-48a2-b448-e335bc2d05e8 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.674150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 779/1571] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:49.674949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595bc6a-7a65-4c96-a3bf-a2074ef79cbc admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.684742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595bc6a-7a65-4c96-a3bf-a2074ef79cbc admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.721602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9549fa8-41b2-48a2-b448-e335bc2d05e8 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.726073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bf673-a391-4591-9ce7-0a93b055489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.726737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bf673-a391-4591-9ce7-0a93b055489c admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.727018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bf673-a391-4591-9ce7-0a93b055489c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.727287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bf673-a391-4591-9ce7-0a93b055489c admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.728014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bf673-a391-4591-9ce7-0a93b055489c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:49.728317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bf673-a391-4591-9ce7-0a93b055489c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.730008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bf673-a391-4591-9ce7-0a93b055489c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.736773 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703e6a6-dec1-4236-a9d1-8183dbd558cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.737491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703e6a6-dec1-4236-a9d1-8183dbd558cd admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.737770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703e6a6-dec1-4236-a9d1-8183dbd558cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.738035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703e6a6-dec1-4236-a9d1-8183dbd558cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.738765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703e6a6-dec1-4236-a9d1-8183dbd558cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.740357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703e6a6-dec1-4236-a9d1-8183dbd558cd admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.741248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 793/1572] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:49.746874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89aee4-fff9-417f-856b-26f72830a8f8 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.747231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89aee4-fff9-417f-856b-26f72830a8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.747567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89aee4-fff9-417f-856b-26f72830a8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.754506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 780/1573] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:49.755399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703e6a6-dec1-4236-a9d1-8183dbd558cd admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.764723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9c89aee4-fff9-417f-856b-26f72830a8f8 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:49.764894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703e6a6-dec1-4236-a9d1-8183dbd558cd admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.765927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9c89aee4-fff9-417f-856b-26f72830a8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:49.769324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b42ec1-3286-43cd-9d12-fdb281c83a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.769959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b42ec1-3286-43cd-9d12-fdb281c83a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.770248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b42ec1-3286-43cd-9d12-fdb281c83a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.770514 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b42ec1-3286-43cd-9d12-fdb281c83a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.771233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b42ec1-3286-43cd-9d12-fdb281c83a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:49.771571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b42ec1-3286-43cd-9d12-fdb281c83a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.773126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b42ec1-3286-43cd-9d12-fdb281c83a1d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.773876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 794/1574] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:49.777245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89aee4-fff9-417f-856b-26f72830a8f8 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.784601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89aee4-fff9-417f-856b-26f72830a8f8 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.794816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 781/1575] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:49.794816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b42ec1-3286-43cd-9d12-fdb281c83a1d admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.796076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a18a71-2674-4ee9-b92e-325e745cc5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.796754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a18a71-2674-4ee9-b92e-325e745cc5bd admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.797034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a18a71-2674-4ee9-b92e-325e745cc5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.797326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a18a71-2674-4ee9-b92e-325e745cc5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.798067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a18a71-2674-4ee9-b92e-325e745cc5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.798226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b42ec1-3286-43cd-9d12-fdb281c83a1d admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.799695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a18a71-2674-4ee9-b92e-325e745cc5bd admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.802738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfedf4-409a-41db-b86b-5a54d1ee8809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.803358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfedf4-409a-41db-b86b-5a54d1ee8809 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.803641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfedf4-409a-41db-b86b-5a54d1ee8809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.803912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfedf4-409a-41db-b86b-5a54d1ee8809 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.804582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfedf4-409a-41db-b86b-5a54d1ee8809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.806603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfedf4-409a-41db-b86b-5a54d1ee8809 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.809736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 795/1576] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:49.810549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a18a71-2674-4ee9-b92e-325e745cc5bd admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.819744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a18a71-2674-4ee9-b92e-325e745cc5bd admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.824642 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73396e45-3efe-464f-9737-116eabbd330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.825362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73396e45-3efe-464f-9737-116eabbd330b admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.825696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73396e45-3efe-464f-9737-116eabbd330b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.826005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73396e45-3efe-464f-9737-116eabbd330b admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.826703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73396e45-3efe-464f-9737-116eabbd330b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.828609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73396e45-3efe-464f-9737-116eabbd330b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.837451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 782/1577] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.837451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfedf4-409a-41db-b86b-5a54d1ee8809 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.848694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 796/1578] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/users => generated 293 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.849715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73396e45-3efe-464f-9737-116eabbd330b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.860693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73396e45-3efe-464f-9737-116eabbd330b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.898425 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfedf4-409a-41db-b86b-5a54d1ee8809 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:49.903384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bfbc0-8b56-4064-8c45-dff483ade9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.904036 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bfbc0-8b56-4064-8c45-dff483ade9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.904316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bfbc0-8b56-4064-8c45-dff483ade9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.904589 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bfbc0-8b56-4064-8c45-dff483ade9c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.905273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bfbc0-8b56-4064-8c45-dff483ade9c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.907200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bfbc0-8b56-4064-8c45-dff483ade9c1 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.913416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac289-4e5c-4c3e-b79a-323f9adb0aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:49.914077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac289-4e5c-4c3e-b79a-323f9adb0aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:49.914382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac289-4e5c-4c3e-b79a-323f9adb0aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:49.914653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac289-4e5c-4c3e-b79a-323f9adb0aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:49.915328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac289-4e5c-4c3e-b79a-323f9adb0aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:49.917388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac289-4e5c-4c3e-b79a-323f9adb0aa5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:49.933714 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 783/1579] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.934586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bfbc0-8b56-4064-8c45-dff483ade9c1 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.947653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 797/1580] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:49 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:49.952067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac289-4e5c-4c3e-b79a-323f9adb0aa5 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:49.995642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bfbc0-8b56-4064-8c45-dff483ade9c1 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.006320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac289-4e5c-4c3e-b79a-323f9adb0aa5 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.009938 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e372d-c164-4ef7-8aab-75c6829aa26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.010595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e372d-c164-4ef7-8aab-75c6829aa26a service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.010919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e372d-c164-4ef7-8aab-75c6829aa26a service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.011212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e372d-c164-4ef7-8aab-75c6829aa26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.049709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84431d51-567e-425a-9479-276b9f4b7a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.050310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84431d51-567e-425a-9479-276b9f4b7a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.050596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84431d51-567e-425a-9479-276b9f4b7a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.050868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84431d51-567e-425a-9479-276b9f4b7a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.051646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84431d51-567e-425a-9479-276b9f4b7a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.053257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84431d51-567e-425a-9479-276b9f4b7a62 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.062906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 784/1581] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.063781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84431d51-567e-425a-9479-276b9f4b7a62 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.074135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e372d-c164-4ef7-8aab-75c6829aa26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.075402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84431d51-567e-425a-9479-276b9f4b7a62 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.075577 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e372d-c164-4ef7-8aab-75c6829aa26a service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.080895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29fe74-3b83-4322-bd10-1199bb87d935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.081577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29fe74-3b83-4322-bd10-1199bb87d935 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.081856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29fe74-3b83-4322-bd10-1199bb87d935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.082124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29fe74-3b83-4322-bd10-1199bb87d935 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.082813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29fe74-3b83-4322-bd10-1199bb87d935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.084648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29fe74-3b83-4322-bd10-1199bb87d935 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.085208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 798/1582] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:50.086051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e372d-c164-4ef7-8aab-75c6829aa26a service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.094709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e372d-c164-4ef7-8aab-75c6829aa26a service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.101566 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c907a2-a110-4860-bca9-ecdd98c1f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.102417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c907a2-a110-4860-bca9-ecdd98c1f524 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.102716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c907a2-a110-4860-bca9-ecdd98c1f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.102966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c907a2-a110-4860-bca9-ecdd98c1f524 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.103715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c907a2-a110-4860-bca9-ecdd98c1f524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.105637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c907a2-a110-4860-bca9-ecdd98c1f524 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.117224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 785/1583] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:50 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:50.117903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29fe74-3b83-4322-bd10-1199bb87d935 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.124870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 799/1584] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.124870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c907a2-a110-4860-bca9-ecdd98c1f524 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.135383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c907a2-a110-4860-bca9-ecdd98c1f524 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.181839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29fe74-3b83-4322-bd10-1199bb87d935 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.187346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489619d-8ce0-4ca0-8c10-afd82771f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.188031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489619d-8ce0-4ca0-8c10-afd82771f1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.188337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489619d-8ce0-4ca0-8c10-afd82771f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.188609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489619d-8ce0-4ca0-8c10-afd82771f1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.189332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489619d-8ce0-4ca0-8c10-afd82771f1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.190382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WARNING py.warnings [None req-e489619d-8ce0-4ca0-8c10-afd82771f1e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:56:50.190382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: warnings.warn(msg) May 04 18:56:50.190382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: May 04 18:56:50.191552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489619d-8ce0-4ca0-8c10-afd82771f1e1 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.196982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b560c-c2e9-445a-bba6-8f80111b3f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.197806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b560c-c2e9-445a-bba6-8f80111b3f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.198145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b560c-c2e9-445a-bba6-8f80111b3f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.198520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b560c-c2e9-445a-bba6-8f80111b3f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.199321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b560c-c2e9-445a-bba6-8f80111b3f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.200986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b560c-c2e9-445a-bba6-8f80111b3f72 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.212786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 800/1585] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.213633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b560c-c2e9-445a-bba6-8f80111b3f72 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.214848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 786/1586] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:50 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:50.215954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489619d-8ce0-4ca0-8c10-afd82771f1e1 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.227347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b560c-c2e9-445a-bba6-8f80111b3f72 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.227675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489619d-8ce0-4ca0-8c10-afd82771f1e1 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.231885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ed26b-dd6d-4bfa-b04d-1e102854fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.232564 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ed26b-dd6d-4bfa-b04d-1e102854fc2a admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.232848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ed26b-dd6d-4bfa-b04d-1e102854fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.233124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ed26b-dd6d-4bfa-b04d-1e102854fc2a admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.233804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f027-6860-4b76-aa90-4153963659f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.233937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ed26b-dd6d-4bfa-b04d-1e102854fc2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.234803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f027-6860-4b76-aa90-4153963659f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.235264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f027-6860-4b76-aa90-4153963659f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.235704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f027-6860-4b76-aa90-4153963659f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.235821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ed26b-dd6d-4bfa-b04d-1e102854fc2a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.236861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3f027-6860-4b76-aa90-4153963659f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.239329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3f027-6860-4b76-aa90-4153963659f7 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.257573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 801/1587] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:50 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:50.258595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ed26b-dd6d-4bfa-b04d-1e102854fc2a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.264899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 787/1588] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:50 2022] POST /identity/v3/users => generated 291 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:50.266660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f027-6860-4b76-aa90-4153963659f7 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.278459 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ed26b-dd6d-4bfa-b04d-1e102854fc2a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.281134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f027-6860-4b76-aa90-4153963659f7 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.283950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59946edd-e6a1-4e6d-aaff-4a9c79472f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.285225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59946edd-e6a1-4e6d-aaff-4a9c79472f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.285735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59946edd-e6a1-4e6d-aaff-4a9c79472f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.286133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59946edd-e6a1-4e6d-aaff-4a9c79472f97 admin admin] PATH_INFO: `/v3/projects/d220357192eb4ba5a2cdd43f000cd4c4/users/b35f3684e2e648148e1273ad6f7b7cb2/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.286583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9816a6-9f3b-4e57-acd7-2301a1b181bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.287550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9816a6-9f3b-4e57-acd7-2301a1b181bc admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.287965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9816a6-9f3b-4e57-acd7-2301a1b181bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.288273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9816a6-9f3b-4e57-acd7-2301a1b181bc admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.288942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9816a6-9f3b-4e57-acd7-2301a1b181bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.292156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9816a6-9f3b-4e57-acd7-2301a1b181bc admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.304224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59946edd-e6a1-4e6d-aaff-4a9c79472f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d220357192eb4ba5a2cdd43f000cd4c4, user_id=b35f3684e2e648148e1273ad6f7b7cb2, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.305587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING py.warnings [None req-59946edd-e6a1-4e6d-aaff-4a9c79472f97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:56:50.305587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: warnings.warn(msg) May 04 18:56:50.305587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: May 04 18:56:50.307539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59946edd-e6a1-4e6d-aaff-4a9c79472f97 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.315485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 788/1589] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:50 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:50.316436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9816a6-9f3b-4e57-acd7-2301a1b181bc admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.326083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9816a6-9f3b-4e57-acd7-2301a1b181bc admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.331908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 802/1590] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:50 2022] PUT /identity/v3/projects/d220357192eb4ba5a2cdd43f000cd4c4/users/b35f3684e2e648148e1273ad6f7b7cb2/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:50.332841 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59946edd-e6a1-4e6d-aaff-4a9c79472f97 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.389239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf83e8e-ec6a-460f-b067-e40083fce23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.391249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf83e8e-ec6a-460f-b067-e40083fce23f admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.391541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf83e8e-ec6a-460f-b067-e40083fce23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.392068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf83e8e-ec6a-460f-b067-e40083fce23f admin admin] PATH_INFO: `/v3/projects/5287a76e646d4a3db0cc508a956314e7/users/c6dc233a47d74b4f87ba15d414f1922d/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.406234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59946edd-e6a1-4e6d-aaff-4a9c79472f97 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.411174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf83e8e-ec6a-460f-b067-e40083fce23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5287a76e646d4a3db0cc508a956314e7, user_id=c6dc233a47d74b4f87ba15d414f1922d, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.412332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c12114-ca88-4d91-8a0e-f0ca67d2a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.413043 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c12114-ca88-4d91-8a0e-f0ca67d2a2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.413485 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c12114-ca88-4d91-8a0e-f0ca67d2a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.413772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c12114-ca88-4d91-8a0e-f0ca67d2a2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.414458 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf83e8e-ec6a-460f-b067-e40083fce23f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.414579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c12114-ca88-4d91-8a0e-f0ca67d2a2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.416178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c12114-ca88-4d91-8a0e-f0ca67d2a2e6 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.430352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 803/1591] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.430352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c12114-ca88-4d91-8a0e-f0ca67d2a2e6 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.432795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 789/1592] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:50 2022] PUT /identity/v3/projects/5287a76e646d4a3db0cc508a956314e7/users/c6dc233a47d74b4f87ba15d414f1922d/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:50.434097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf83e8e-ec6a-460f-b067-e40083fce23f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.442254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c12114-ca88-4d91-8a0e-f0ca67d2a2e6 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.507967 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaf9da-df06-4456-9443-b534467c3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.509034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaf9da-df06-4456-9443-b534467c3fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.509175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaf9da-df06-4456-9443-b534467c3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.509587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaf9da-df06-4456-9443-b534467c3fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.510395 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaf9da-df06-4456-9443-b534467c3fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.512474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaf9da-df06-4456-9443-b534467c3fdb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.517686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf83e8e-ec6a-460f-b067-e40083fce23f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.523539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c85af-d863-4f52-8a7e-45b1030edb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.523752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 804/1593] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.524231 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c85af-d863-4f52-8a7e-45b1030edb6f admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.524231 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c85af-d863-4f52-8a7e-45b1030edb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.524431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c85af-d863-4f52-8a7e-45b1030edb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.524542 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaf9da-df06-4456-9443-b534467c3fdb admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.525467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c85af-d863-4f52-8a7e-45b1030edb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.527247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c85af-d863-4f52-8a7e-45b1030edb6f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.538329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaf9da-df06-4456-9443-b534467c3fdb admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.541962 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 790/1594] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.543098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c85af-d863-4f52-8a7e-45b1030edb6f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.552313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996e3d0-3d41-412f-b13d-1b5f1f972367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.552979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996e3d0-3d41-412f-b13d-1b5f1f972367 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.553263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996e3d0-3d41-412f-b13d-1b5f1f972367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.553572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996e3d0-3d41-412f-b13d-1b5f1f972367 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.554438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996e3d0-3d41-412f-b13d-1b5f1f972367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.555998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996e3d0-3d41-412f-b13d-1b5f1f972367 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.557359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c85af-d863-4f52-8a7e-45b1030edb6f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.562951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aefb8-ec47-4d5c-aca1-3945077d0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.564254 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aefb8-ec47-4d5c-aca1-3945077d0e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.564654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aefb8-ec47-4d5c-aca1-3945077d0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.565174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aefb8-ec47-4d5c-aca1-3945077d0e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.565974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90aefb8-ec47-4d5c-aca1-3945077d0e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.571856 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 805/1595] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.572077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90aefb8-ec47-4d5c-aca1-3945077d0e01 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.572194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22873ad-0940-497a-b34b-df270dfe9f10 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.572194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22873ad-0940-497a-b34b-df270dfe9f10 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.572194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22873ad-0940-497a-b34b-df270dfe9f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.581329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 791/1596] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.582195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aefb8-ec47-4d5c-aca1-3945077d0e01 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.591634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c22873ad-0940-497a-b34b-df270dfe9f10 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:50.592433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aefb8-ec47-4d5c-aca1-3945077d0e01 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.592880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c22873ad-0940-497a-b34b-df270dfe9f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:50.597236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39882ed3-fc56-4da9-a409-f92d4cd6a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.598184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39882ed3-fc56-4da9-a409-f92d4cd6a392 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.598466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39882ed3-fc56-4da9-a409-f92d4cd6a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.598744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39882ed3-fc56-4da9-a409-f92d4cd6a392 admin admin] PATH_INFO: `/v3/projects/dd17f7a747ad43fc905b8d1688a71ba7/users/c983699bd73f41fc813c41c498261ece/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.601343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 806/1597] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:50.602702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adebfb-644f-425d-84e7-4ef6e8144d3a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.603078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adebfb-644f-425d-84e7-4ef6e8144d3a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.603442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adebfb-644f-425d-84e7-4ef6e8144d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.618842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39882ed3-fc56-4da9-a409-f92d4cd6a392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd17f7a747ad43fc905b8d1688a71ba7, user_id=c983699bd73f41fc813c41c498261ece, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.621424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d5adebfb-644f-425d-84e7-4ef6e8144d3a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:50.622039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39882ed3-fc56-4da9-a409-f92d4cd6a392 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.622847 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d5adebfb-644f-425d-84e7-4ef6e8144d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:50.635041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 807/1598] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:50.635041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adebfb-644f-425d-84e7-4ef6e8144d3a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.638595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 792/1599] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:50 2022] PUT /identity/v3/projects/dd17f7a747ad43fc905b8d1688a71ba7/users/c983699bd73f41fc813c41c498261ece/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:50.639351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39882ed3-fc56-4da9-a409-f92d4cd6a392 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.648807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adebfb-644f-425d-84e7-4ef6e8144d3a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.698198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39882ed3-fc56-4da9-a409-f92d4cd6a392 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.703041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd01e9-2e15-4d03-b7aa-836f8c1f6ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.703790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd01e9-2e15-4d03-b7aa-836f8c1f6ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.704134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd01e9-2e15-4d03-b7aa-836f8c1f6ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.704470 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd01e9-2e15-4d03-b7aa-836f8c1f6ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.705201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd01e9-2e15-4d03-b7aa-836f8c1f6ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.706416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8883125-44e5-47fa-ab88-e75dc3aa861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.706828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd01e9-2e15-4d03-b7aa-836f8c1f6ec6 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.707401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8883125-44e5-47fa-ab88-e75dc3aa861d admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.707794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8883125-44e5-47fa-ab88-e75dc3aa861d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.708309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8883125-44e5-47fa-ab88-e75dc3aa861d admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.709155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8883125-44e5-47fa-ab88-e75dc3aa861d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.710860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8883125-44e5-47fa-ab88-e75dc3aa861d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.719891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 793/1600] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.719891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd01e9-2e15-4d03-b7aa-836f8c1f6ec6 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.724137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 808/1601] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.725304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8883125-44e5-47fa-ab88-e75dc3aa861d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.733109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd01e9-2e15-4d03-b7aa-836f8c1f6ec6 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.736385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8883125-44e5-47fa-ab88-e75dc3aa861d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.738220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517f27b-496e-4589-945d-42969ddc76bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.739158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517f27b-496e-4589-945d-42969ddc76bf admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.739486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517f27b-496e-4589-945d-42969ddc76bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.739819 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517f27b-496e-4589-945d-42969ddc76bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.743265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517f27b-496e-4589-945d-42969ddc76bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.743265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517f27b-496e-4589-945d-42969ddc76bf admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.749119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8426e22-569e-4876-b9bb-93e635f1e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.750053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8426e22-569e-4876-b9bb-93e635f1e218 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.750350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8426e22-569e-4876-b9bb-93e635f1e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.751134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8426e22-569e-4876-b9bb-93e635f1e218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.751946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8426e22-569e-4876-b9bb-93e635f1e218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.753800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8426e22-569e-4876-b9bb-93e635f1e218 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.755966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 794/1602] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.756353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517f27b-496e-4589-945d-42969ddc76bf admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.773179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 809/1603] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:50.773179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c0ad-7689-4c26-bccb-62c67efb3563 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.773179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c0ad-7689-4c26-bccb-62c67efb3563 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.773179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c0ad-7689-4c26-bccb-62c67efb3563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.793518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-69e2c0ad-7689-4c26-bccb-62c67efb3563 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:50.794937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-69e2c0ad-7689-4c26-bccb-62c67efb3563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:50.819456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 810/1604] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:50.820530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2c0ad-7689-4c26-bccb-62c67efb3563 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.824926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517f27b-496e-4589-945d-42969ddc76bf admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.828833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8963f8-0bb3-4f1a-b5a2-2d00003e882c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.829606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8963f8-0bb3-4f1a-b5a2-2d00003e882c service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.829944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8963f8-0bb3-4f1a-b5a2-2d00003e882c service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.830284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8963f8-0bb3-4f1a-b5a2-2d00003e882c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.830449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2c0ad-7689-4c26-bccb-62c67efb3563 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.833916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88247-fbb2-4b99-b33f-1abeff681ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.834534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88247-fbb2-4b99-b33f-1abeff681ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.834896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88247-fbb2-4b99-b33f-1abeff681ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.835199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88247-fbb2-4b99-b33f-1abeff681ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.840289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8963f8-0bb3-4f1a-b5a2-2d00003e882c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.841879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8963f8-0bb3-4f1a-b5a2-2d00003e882c service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.845528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de88247-fbb2-4b99-b33f-1abeff681ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.846959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de88247-fbb2-4b99-b33f-1abeff681ed8 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.852531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 795/1605] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:50.853451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8963f8-0bb3-4f1a-b5a2-2d00003e882c service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.862694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8963f8-0bb3-4f1a-b5a2-2d00003e882c service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.868603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 811/1606] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:50.869479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88247-fbb2-4b99-b33f-1abeff681ed8 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.873973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996506e-cf9b-437c-b387-b06c4dd06d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.874901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996506e-cf9b-437c-b387-b06c4dd06d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.875182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996506e-cf9b-437c-b387-b06c4dd06d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.875492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996506e-cf9b-437c-b387-b06c4dd06d28 admin admin] PATH_INFO: `/v3/projects/aa8f8387294749139d18c7dfc60e60b6/users/d8d86ea283454bf8a5379d86036941be/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.883742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88247-fbb2-4b99-b33f-1abeff681ed8 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:50.889480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9037-0f9e-40c3-ac4b-d43a3abce765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:50.890640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9037-0f9e-40c3-ac4b-d43a3abce765 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:50.890999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9037-0f9e-40c3-ac4b-d43a3abce765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:50.891181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9037-0f9e-40c3-ac4b-d43a3abce765 admin admin] PATH_INFO: `/v3/projects/a42cb39e34c5497496e00c7a842cd3e5/users/c7f615e0c93b43ea8a3a74a8150c6e7f/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:50.908130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed9037-0f9e-40c3-ac4b-d43a3abce765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42cb39e34c5497496e00c7a842cd3e5, user_id=c7f615e0c93b43ea8a3a74a8150c6e7f, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.910739 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996506e-cf9b-437c-b387-b06c4dd06d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8f8387294749139d18c7dfc60e60b6, user_id=d8d86ea283454bf8a5379d86036941be, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:50.911156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed9037-0f9e-40c3-ac4b-d43a3abce765 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.914217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996506e-cf9b-437c-b387-b06c4dd06d28 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:50.927196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 812/1607] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:50 2022] PUT /identity/v3/projects/a42cb39e34c5497496e00c7a842cd3e5/users/c7f615e0c93b43ea8a3a74a8150c6e7f/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:50.928309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9037-0f9e-40c3-ac4b-d43a3abce765 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:50.934123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 796/1608] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:50 2022] PUT /identity/v3/projects/aa8f8387294749139d18c7dfc60e60b6/users/d8d86ea283454bf8a5379d86036941be/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:50.935003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996506e-cf9b-437c-b387-b06c4dd06d28 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:51.067881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9037-0f9e-40c3-ac4b-d43a3abce765 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:51.077222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf5ce7-5fba-47f8-89ca-b0fbb8508b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:51.078218 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf5ce7-5fba-47f8-89ca-b0fbb8508b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.078519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf5ce7-5fba-47f8-89ca-b0fbb8508b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.078851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf5ce7-5fba-47f8-89ca-b0fbb8508b06 admin admin] PATH_INFO: `/v3/projects/e3511ea328864fb782d9ded7da6e1b83/users/37bdc8fd9f824937bf55ad43daae4787/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.092898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996506e-cf9b-437c-b387-b06c4dd06d28 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:51.099126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf5ce7-5fba-47f8-89ca-b0fbb8508b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3511ea328864fb782d9ded7da6e1b83, user_id=37bdc8fd9f824937bf55ad43daae4787, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:51.103070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf5ce7-5fba-47f8-89ca-b0fbb8508b06 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:51.105015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005fc10-15a5-4ca9-90e6-56b095c09793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:51.106823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005fc10-15a5-4ca9-90e6-56b095c09793 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.108583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005fc10-15a5-4ca9-90e6-56b095c09793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.109113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005fc10-15a5-4ca9-90e6-56b095c09793 admin admin] PATH_INFO: `/v3/projects/5371f79e157f4af2abdd545d03cd92b6/users/ed553623095746d8aa852406e1b2ec92/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.123342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 813/1609] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:50 2022] PUT /identity/v3/projects/e3511ea328864fb782d9ded7da6e1b83/users/37bdc8fd9f824937bf55ad43daae4787/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:51.124972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af74d7-fe28-4762-9fe7-0656d2e5faff None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.125438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af74d7-fe28-4762-9fe7-0656d2e5faff None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.126040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af74d7-fe28-4762-9fe7-0656d2e5faff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.143614 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005fc10-15a5-4ca9-90e6-56b095c09793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5371f79e157f4af2abdd545d03cd92b6, user_id=ed553623095746d8aa852406e1b2ec92, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:51.146355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005fc10-15a5-4ca9-90e6-56b095c09793 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:51.177364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-98af74d7-fe28-4762-9fe7-0656d2e5faff None None] MFA Rules not processed for user `66b7e19a875c48069bec426b1b2efa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:51.179840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-98af74d7-fe28-4762-9fe7-0656d2e5faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:51.192376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 797/1610] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:50 2022] PUT /identity/v3/projects/5371f79e157f4af2abdd545d03cd92b6/users/ed553623095746d8aa852406e1b2ec92/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:51.193582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005fc10-15a5-4ca9-90e6-56b095c09793 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:51.289586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005fc10-15a5-4ca9-90e6-56b095c09793 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:51.305412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892aba2f-ae34-41ab-8863-8eb2411ed1e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:51.305412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aba2f-ae34-41ab-8863-8eb2411ed1e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.305412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aba2f-ae34-41ab-8863-8eb2411ed1e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.305412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aba2f-ae34-41ab-8863-8eb2411ed1e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.306900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 814/1611] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:51.308492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef32f5-8b45-47ac-a8a4-f45274432141 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.310877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef32f5-8b45-47ac-a8a4-f45274432141 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.313508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef32f5-8b45-47ac-a8a4-f45274432141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.355324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-91ef32f5-8b45-47ac-a8a4-f45274432141 None None] MFA Rules not processed for user `c7f615e0c93b43ea8a3a74a8150c6e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:51.356629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-91ef32f5-8b45-47ac-a8a4-f45274432141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:51.412497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aba2f-ae34-41ab-8863-8eb2411ed1e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:51.414751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aba2f-ae34-41ab-8863-8eb2411ed1e4 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:51.430913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 798/1612] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:51.432964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644c90-d573-466e-8a36-f2597f898d63 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.433475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644c90-d573-466e-8a36-f2597f898d63 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.433916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644c90-d573-466e-8a36-f2597f898d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.454769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 815/1613] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:51.454769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa592-8f77-4291-9528-3bfcc661c489 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.454769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa592-8f77-4291-9528-3bfcc661c489 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.454769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa592-8f77-4291-9528-3bfcc661c489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.481758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-5d644c90-d573-466e-8a36-f2597f898d63 None None] MFA Rules not processed for user `d8d86ea283454bf8a5379d86036941be`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:51.483245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5d644c90-d573-466e-8a36-f2597f898d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:51.493512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-de7fa592-8f77-4291-9528-3bfcc661c489 None None] MFA Rules not processed for user `37bdc8fd9f824937bf55ad43daae4787`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:51.497744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-de7fa592-8f77-4291-9528-3bfcc661c489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:51.582402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 816/1614] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:51.584035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8ef83-067a-4931-9fa8-f0e9a291baa4 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.586040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8ef83-067a-4931-9fa8-f0e9a291baa4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.586321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8ef83-067a-4931-9fa8-f0e9a291baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.591133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 799/1615] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:51.596932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1630a90-f9aa-4a99-9c31-8f543e637c70 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.597216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1630a90-f9aa-4a99-9c31-8f543e637c70 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.597523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1630a90-f9aa-4a99-9c31-8f543e637c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.618996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a1630a90-f9aa-4a99-9c31-8f543e637c70 None None] MFA Rules not processed for user `66b7e19a875c48069bec426b1b2efa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:51.620899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a1630a90-f9aa-4a99-9c31-8f543e637c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:51.629800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-54c8ef83-067a-4931-9fa8-f0e9a291baa4 None None] MFA Rules not processed for user `ed553623095746d8aa852406e1b2ec92`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:51.634286 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 800/1616] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:51.634286 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1630a90-f9aa-4a99-9c31-8f543e637c70 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:51.634460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-54c8ef83-067a-4931-9fa8-f0e9a291baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:51.740820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1630a90-f9aa-4a99-9c31-8f543e637c70 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:51.747402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2d8c5-28a2-4598-bbac-11b5a5975f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:51.748214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2d8c5-28a2-4598-bbac-11b5a5975f94 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.748571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2d8c5-28a2-4598-bbac-11b5a5975f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.748905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2d8c5-28a2-4598-bbac-11b5a5975f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.761364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 817/1617] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:51.761364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8ef83-067a-4931-9fa8-f0e9a291baa4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:51.762099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2d8c5-28a2-4598-bbac-11b5a5975f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:51.762790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2d8c5-28a2-4598-bbac-11b5a5975f94 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:51.784803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8ef83-067a-4931-9fa8-f0e9a291baa4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:51.787168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 801/1618] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:51.788822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f78e5-484c-425f-b1fd-22415c9f5999 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.793224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f78e5-484c-425f-b1fd-22415c9f5999 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.793645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f78e5-484c-425f-b1fd-22415c9f5999 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.798673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 802/1619] 10.222.0.35 () {54 vars in 960 bytes} [Wed May 4 18:56:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:51.798857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daf851-a70f-4f9e-b663-ef841c763912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:51.799523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daf851-a70f-4f9e-b663-ef841c763912 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.799805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daf851-a70f-4f9e-b663-ef841c763912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.800084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daf851-a70f-4f9e-b663-ef841c763912 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.802269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc793fa8-7410-4b52-aad5-6a116f54c879 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.802563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc793fa8-7410-4b52-aad5-6a116f54c879 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.802844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc793fa8-7410-4b52-aad5-6a116f54c879 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.802995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daf851-a70f-4f9e-b663-ef841c763912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:51.806167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daf851-a70f-4f9e-b663-ef841c763912 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:51.814101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 803/1620] 10.222.0.35 () {54 vars in 960 bytes} [Wed May 4 18:56:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:51.815604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02709737-da7e-414d-b4b9-a44a17a10241 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.815894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02709737-da7e-414d-b4b9-a44a17a10241 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.816168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02709737-da7e-414d-b4b9-a44a17a10241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.852926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-02709737-da7e-414d-b4b9-a44a17a10241 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:51.854355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-02709737-da7e-414d-b4b9-a44a17a10241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:51.868139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 818/1621] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:51 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:51.869436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a6fac-fe3a-4cd2-a205-a6119a5c47ac None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:51.869725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a6fac-fe3a-4cd2-a205-a6119a5c47ac None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:51.870003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a6fac-fe3a-4cd2-a205-a6119a5c47ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:51.908549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c99a6fac-fe3a-4cd2-a205-a6119a5c47ac None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:51.909994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c99a6fac-fe3a-4cd2-a205-a6119a5c47ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:52.038837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 804/1622] 10.222.0.35 () {58 vars in 1057 bytes} [Wed May 4 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:52.040055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02709737-da7e-414d-b4b9-a44a17a10241 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:52.055991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 819/1623] 10.222.0.35 () {58 vars in 1057 bytes} [Wed May 4 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:52.056869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a6fac-fe3a-4cd2-a205-a6119a5c47ac None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:52.068823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02709737-da7e-414d-b4b9-a44a17a10241 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:52.075146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a6fac-fe3a-4cd2-a205-a6119a5c47ac None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:52.094976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89fe2e-b9d8-479f-ab11-e47c13c2a890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:52.095662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89fe2e-b9d8-479f-ab11-e47c13c2a890 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.095943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89fe2e-b9d8-479f-ab11-e47c13c2a890 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.096214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89fe2e-b9d8-479f-ab11-e47c13c2a890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.223218 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89fe2e-b9d8-479f-ab11-e47c13c2a890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:52.224854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89fe2e-b9d8-479f-ab11-e47c13c2a890 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:52.255211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 820/1624] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:52.256192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89fe2e-b9d8-479f-ab11-e47c13c2a890 service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:52.256982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f00c1-15c3-458e-8cb5-6cbc9e2a243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:52.257719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f00c1-15c3-458e-8cb5-6cbc9e2a243a admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.258003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f00c1-15c3-458e-8cb5-6cbc9e2a243a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.258279 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f00c1-15c3-458e-8cb5-6cbc9e2a243a admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.261426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f00c1-15c3-458e-8cb5-6cbc9e2a243a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:52.267399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f00c1-15c3-458e-8cb5-6cbc9e2a243a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:52.271461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89fe2e-b9d8-479f-ab11-e47c13c2a890 service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:52.294884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fdb08-865a-4b79-8d96-6862beae7a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:52.295603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fdb08-865a-4b79-8d96-6862beae7a69 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.296013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fdb08-865a-4b79-8d96-6862beae7a69 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.296294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fdb08-865a-4b79-8d96-6862beae7a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.312681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 805/1625] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:52 2022] POST /identity/v3/users => generated 296 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:56:52.317257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f00c1-15c3-458e-8cb5-6cbc9e2a243a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:52.328963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f00c1-15c3-458e-8cb5-6cbc9e2a243a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:52.335521 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0efc-a1d6-46a8-9830-0752d63dc92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:52.336337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0efc-a1d6-46a8-9830-0752d63dc92c admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.336883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0efc-a1d6-46a8-9830-0752d63dc92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.338620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0efc-a1d6-46a8-9830-0752d63dc92c admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.339769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0efc-a1d6-46a8-9830-0752d63dc92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:52.342633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0efc-a1d6-46a8-9830-0752d63dc92c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:52.369275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 806/1626] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:52.370873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0efc-a1d6-46a8-9830-0752d63dc92c admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:52.387170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0efc-a1d6-46a8-9830-0752d63dc92c admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:52.400459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638a10-1ebe-4e45-860f-4c28a0af8def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:52.408253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638a10-1ebe-4e45-860f-4c28a0af8def admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.408745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638a10-1ebe-4e45-860f-4c28a0af8def admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.409041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638a10-1ebe-4e45-860f-4c28a0af8def admin admin] PATH_INFO: `/v3/projects/a68d04323fdb475db78c7642694fdaec/users/989c3094c0da431aaeae817e89bf7261/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.415689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fdb08-865a-4b79-8d96-6862beae7a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:52.417517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fdb08-865a-4b79-8d96-6862beae7a69 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:52.444546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638a10-1ebe-4e45-860f-4c28a0af8def admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68d04323fdb475db78c7642694fdaec, user_id=989c3094c0da431aaeae817e89bf7261, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:52.448109 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 821/1627] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:52.456564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638a10-1ebe-4e45-860f-4c28a0af8def admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:52.495968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 807/1628] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:52 2022] PUT /identity/v3/projects/a68d04323fdb475db78c7642694fdaec/users/989c3094c0da431aaeae817e89bf7261/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:52.496848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fdb08-865a-4b79-8d96-6862beae7a69 service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:52.514005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fdb08-865a-4b79-8d96-6862beae7a69 service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:52.625869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a7844-96a2-47a1-a04f-76da387aeead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:52.636016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a7844-96a2-47a1-a04f-76da387aeead admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.636411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a7844-96a2-47a1-a04f-76da387aeead admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.636698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a7844-96a2-47a1-a04f-76da387aeead admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.637588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a7844-96a2-47a1-a04f-76da387aeead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:52.639250 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a7844-96a2-47a1-a04f-76da387aeead admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:52.654439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 822/1629] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:56:52.660098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638a10-1ebe-4e45-860f-4c28a0af8def admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:52.702879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638a10-1ebe-4e45-860f-4c28a0af8def admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:52.711835 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5879a-d186-453f-b9db-36d697291cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:52.713070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5879a-d186-453f-b9db-36d697291cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.713838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5879a-d186-453f-b9db-36d697291cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.714537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5879a-d186-453f-b9db-36d697291cc1 admin admin] PATH_INFO: `/v3/projects/a68d04323fdb475db78c7642694fdaec/users/989c3094c0da431aaeae817e89bf7261/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.717687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5879a-d186-453f-b9db-36d697291cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68d04323fdb475db78c7642694fdaec, user_id=989c3094c0da431aaeae817e89bf7261, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:52.722470 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5879a-d186-453f-b9db-36d697291cc1 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:52.744666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 808/1630] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:56:52 2022] PUT /identity/v3/projects/a68d04323fdb475db78c7642694fdaec/users/989c3094c0da431aaeae817e89bf7261/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:52.748185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74610-606a-4273-8394-24080743ca36 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.748474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74610-606a-4273-8394-24080743ca36 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.748915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74610-606a-4273-8394-24080743ca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.800366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-dbb74610-606a-4273-8394-24080743ca36 None None] MFA Rules not processed for user `989c3094c0da431aaeae817e89bf7261`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:52.801641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-dbb74610-606a-4273-8394-24080743ca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:52.880713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b91d0-2527-4022-9f59-bfa106be41b6 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.881004 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b91d0-2527-4022-9f59-bfa106be41b6 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.881330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b91d0-2527-4022-9f59-bfa106be41b6 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.883074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 809/1631] 10.222.0.35 () {54 vars in 912 bytes} [Wed May 4 18:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:52.890215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85866865-4d3a-42f8-82b2-544bfbdaa1e2 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:52.890728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85866865-4d3a-42f8-82b2-544bfbdaa1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:52.891189 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85866865-4d3a-42f8-82b2-544bfbdaa1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:52.935289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-85866865-4d3a-42f8-82b2-544bfbdaa1e2 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:52.936606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-85866865-4d3a-42f8-82b2-544bfbdaa1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:52.940286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 823/1632] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:52.958827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb74610-606a-4273-8394-24080743ca36 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:53.069349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 810/1633] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 18:56:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 04 18:56:53.071492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609da0-2eb2-4260-941d-d9bb2f84d63f None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:53.071987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609da0-2eb2-4260-941d-d9bb2f84d63f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:53.072838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609da0-2eb2-4260-941d-d9bb2f84d63f None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:53.075484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb74610-606a-4273-8394-24080743ca36 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:53.087417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 811/1634] 10.222.0.35 () {54 vars in 912 bytes} [Wed May 4 18:56:53 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:53.088533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02ef0-0b17-449a-af39-069cfaa2a41f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:53.089501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02ef0-0b17-449a-af39-069cfaa2a41f service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:53.089909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02ef0-0b17-449a-af39-069cfaa2a41f service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:53.090197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02ef0-0b17-449a-af39-069cfaa2a41f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:53.090326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609da0-2eb2-4260-941d-d9bb2f84d63f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:53.105152 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609da0-2eb2-4260-941d-d9bb2f84d63f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:53.108862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc02ef0-0b17-449a-af39-069cfaa2a41f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:53.109354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8779-975e-4571-9500-1157b0213588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:53.110321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8779-975e-4571-9500-1157b0213588 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:53.110464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc02ef0-0b17-449a-af39-069cfaa2a41f service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:53.111644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8779-975e-4571-9500-1157b0213588 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:53.116454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8779-975e-4571-9500-1157b0213588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:53.137708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b8779-975e-4571-9500-1157b0213588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:53.139769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b8779-975e-4571-9500-1157b0213588 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:53.140971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 824/1635] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:56:53.142436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08618ac-74d3-488b-af99-122a0fc10fe3 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:53.142764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08618ac-74d3-488b-af99-122a0fc10fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:53.143045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08618ac-74d3-488b-af99-122a0fc10fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:53.162295 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 812/1636] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:53.181435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c08618ac-74d3-488b-af99-122a0fc10fe3 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:53.183075 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c08618ac-74d3-488b-af99-122a0fc10fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:53.199562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 825/1637] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 18:56:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:53.215723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8779-975e-4571-9500-1157b0213588 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:53.218101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ba7b8779-975e-4571-9500-1157b0213588 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:53.364440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08618ac-74d3-488b-af99-122a0fc10fe3 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:53.381147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8779-975e-4571-9500-1157b0213588 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:53.382803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08618ac-74d3-488b-af99-122a0fc10fe3 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:53.390044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31364-78c9-4455-9d7b-62a1068185d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63b338ae7e374ba5a7542c5a53deb416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:53.392009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31364-78c9-4455-9d7b-62a1068185d1 service glance] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:53.392402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31364-78c9-4455-9d7b-62a1068185d1 service glance] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:53.392604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa44abd-f165-4f4d-b582-7fd4a65da1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:53.393460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa44abd-f165-4f4d-b582-7fd4a65da1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:53.393866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31364-78c9-4455-9d7b-62a1068185d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:53.394043 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa44abd-f165-4f4d-b582-7fd4a65da1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:53.395116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa44abd-f165-4f4d-b582-7fd4a65da1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:53.427744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d31364-78c9-4455-9d7b-62a1068185d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:53.429398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d31364-78c9-4455-9d7b-62a1068185d1 service glance] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:53.487616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 813/1638] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:53.602917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa44abd-f165-4f4d-b582-7fd4a65da1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:53.608775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa44abd-f165-4f4d-b582-7fd4a65da1c1 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:53.660852 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 826/1639] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:54.389609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31364-78c9-4455-9d7b-62a1068185d1 service glance] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:54.406403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31364-78c9-4455-9d7b-62a1068185d1 service glance] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:54.424823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44aeb52-f897-46f6-ae31-5119a7e3e210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:54.426049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44aeb52-f897-46f6-ae31-5119a7e3e210 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:54.426584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44aeb52-f897-46f6-ae31-5119a7e3e210 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:54.429149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44aeb52-f897-46f6-ae31-5119a7e3e210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:54.513812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d756-a344-4bc1-afe1-5646d3f2a524 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:54.514379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d756-a344-4bc1-afe1-5646d3f2a524 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:54.514592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d756-a344-4bc1-afe1-5646d3f2a524 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:54.518549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 827/1640] 10.222.0.35 () {54 vars in 912 bytes} [Wed May 4 18:56:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:54.525330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163b487-ba39-412f-9749-da403f7cf3c6 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:54.525744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163b487-ba39-412f-9749-da403f7cf3c6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:54.526041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163b487-ba39-412f-9749-da403f7cf3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:54.569279 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44aeb52-f897-46f6-ae31-5119a7e3e210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:54.571326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44aeb52-f897-46f6-ae31-5119a7e3e210 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:54.576115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b163b487-ba39-412f-9749-da403f7cf3c6 None None] MFA Rules not processed for user `94b338c27d664f51bc9de29c9c6ba40e`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:54.577476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b163b487-ba39-412f-9749-da403f7cf3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:54.593196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 814/1641] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:54.670030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 828/1642] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 18:56:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:54.725861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44aeb52-f897-46f6-ae31-5119a7e3e210 service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:54.740356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44aeb52-f897-46f6-ae31-5119a7e3e210 service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:54.754382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ebc11-ab60-49c3-b38b-857d2fdc1c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:54.755057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ebc11-ab60-49c3-b38b-857d2fdc1c2e service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:54.755339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ebc11-ab60-49c3-b38b-857d2fdc1c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:54.755613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ebc11-ab60-49c3-b38b-857d2fdc1c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:54.770271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ebc11-ab60-49c3-b38b-857d2fdc1c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:54.771736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ebc11-ab60-49c3-b38b-857d2fdc1c2e service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:54.798024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 815/1643] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:56.066777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163b487-ba39-412f-9749-da403f7cf3c6 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:56.252372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163b487-ba39-412f-9749-da403f7cf3c6 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:56.269008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:56.269997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:56.270246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:56.270523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] PATH_INFO: `/v3/users/ed553623095746d8aa852406e1b2ec92` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:56.271776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed553623095746d8aa852406e1b2ec92)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:56.272812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: WARNING py.warnings [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:56:56.272812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: warnings.warn(msg) May 04 18:56:56.272812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: May 04 18:56:56.277735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:56.423047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d3707-2767-45da-b060-78151820a39c None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:56.423943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d3707-2767-45da-b060-78151820a39c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:56.424587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d3707-2767-45da-b060-78151820a39c None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:56.426489 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 816/1644] 10.222.0.35 () {54 vars in 960 bytes} [Wed May 4 18:56:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:56:56.427994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed553623095746d8aa852406e1b2ec92'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:56.434130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c169daf-66d9-4574-b09d-b70cf78cb371 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:56.434654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c169daf-66d9-4574-b09d-b70cf78cb371 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:56.435130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c169daf-66d9-4574-b09d-b70cf78cb371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:56.442158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed553623095746d8aa852406e1b2ec92'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:56.443503 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed553623095746d8aa852406e1b2ec92'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:56.444421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed553623095746d8aa852406e1b2ec92'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:56.462509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-64b7fc45-6e47-47a3-87fc-e588da17a431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed553623095746d8aa852406e1b2ec92'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:56.476201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9c169daf-66d9-4574-b09d-b70cf78cb371 None None] MFA Rules not processed for user `f6eaf63f68734bdd938aa0ea7d0c4441`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:56.478114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9c169daf-66d9-4574-b09d-b70cf78cb371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:56.488063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 829/1645] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:56:56 2022] DELETE /identity/v3/users/ed553623095746d8aa852406e1b2ec92 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:56.502514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50020fe3-cfac-4b72-9e5e-758aa652f221 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:56.504714 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50020fe3-cfac-4b72-9e5e-758aa652f221 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:56.505870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50020fe3-cfac-4b72-9e5e-758aa652f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:56.555901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-50020fe3-cfac-4b72-9e5e-758aa652f221 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:56.559035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-50020fe3-cfac-4b72-9e5e-758aa652f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:56.660806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 817/1646] 10.222.0.35 () {58 vars in 1057 bytes} [Wed May 4 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:56:56.669521 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c169daf-66d9-4574-b09d-b70cf78cb371 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:56.689727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c169daf-66d9-4574-b09d-b70cf78cb371 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:56.701347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 830/1647] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:56.731614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50020fe3-cfac-4b72-9e5e-758aa652f221 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:56.733087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-50020fe3-cfac-4b72-9e5e-758aa652f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:56.821862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6eaf63f68734bdd938aa0ea7d0c4441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:56.825109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:56.825845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:56.826119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:56.832120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:56.881074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:56.899822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:56.930629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50020fe3-cfac-4b72-9e5e-758aa652f221 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:56.940119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc66c70-9992-4ef8-9774-8f710d1baae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:56.941000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 818/1648] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:56:56.941384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc66c70-9992-4ef8-9774-8f710d1baae4 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:56.941647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc66c70-9992-4ef8-9774-8f710d1baae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:56.941921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc66c70-9992-4ef8-9774-8f710d1baae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:56.967159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc66c70-9992-4ef8-9774-8f710d1baae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:56.968909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc66c70-9992-4ef8-9774-8f710d1baae4 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:56.997269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 831/1649] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:56:58.465975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:58.467571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:58.498372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122969f-56a2-4f23-82d1-5b24a271ba5c service placement] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:58.524293 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:58.528705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:58.529201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:58.529653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] PATH_INFO: `/v3/projects/5371f79e157f4af2abdd545d03cd92b6` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:58.531285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5371f79e157f4af2abdd545d03cd92b6)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:58.532517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: WARNING py.warnings [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 18:56:58.532517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: warnings.warn(msg) May 04 18:56:58.532517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: May 04 18:56:58.534271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:58.674493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5371f79e157f4af2abdd545d03cd92b6', 'request_id': 'req-721a1ebc-e202-431a-a5d3-5fad40ebd148'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:58.721490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5371f79e157f4af2abdd545d03cd92b6', 'request_id': 'req-721a1ebc-e202-431a-a5d3-5fad40ebd148'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:58.747184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5371f79e157f4af2abdd545d03cd92b6', 'request_id': 'req-721a1ebc-e202-431a-a5d3-5fad40ebd148'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:58.769257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] The token cache is being invalidate because project 5371f79e157f4af2abdd545d03cd92b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:56:58.769882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:58.773056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-721a1ebc-e202-431a-a5d3-5fad40ebd148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:56:58.778523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 819/1650] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:56:58 2022] DELETE /identity/v3/projects/5371f79e157f4af2abdd545d03cd92b6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:56:58.780259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cf8b2-287c-4e62-b7b3-20e0baf16272 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:58.781078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cf8b2-287c-4e62-b7b3-20e0baf16272 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:58.781523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cf8b2-287c-4e62-b7b3-20e0baf16272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:58.842519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-bc6cf8b2-287c-4e62-b7b3-20e0baf16272 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:58.843897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-bc6cf8b2-287c-4e62-b7b3-20e0baf16272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:59.309833 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 832/1651] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:59.324617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e94e20-c0fd-4b4f-8025-58433984acdc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:59.324951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e94e20-c0fd-4b4f-8025-58433984acdc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:59.325219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e94e20-c0fd-4b4f-8025-58433984acdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:59.374603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-b2e94e20-c0fd-4b4f-8025-58433984acdc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:59.377777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b2e94e20-c0fd-4b4f-8025-58433984acdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:59.405585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cf8b2-287c-4e62-b7b3-20e0baf16272 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:59.415862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 820/1652] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:56:59.422490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cf8b2-287c-4e62-b7b3-20e0baf16272 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:59.433853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac610a1f-5572-444b-804e-d1257e027496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:59.434536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac610a1f-5572-444b-804e-d1257e027496 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:59.434818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac610a1f-5572-444b-804e-d1257e027496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:59.435089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac610a1f-5572-444b-804e-d1257e027496 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:59.435818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac610a1f-5572-444b-804e-d1257e027496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:56:59.436122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac610a1f-5572-444b-804e-d1257e027496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:59.452389 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac610a1f-5572-444b-804e-d1257e027496 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:59.507619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 833/1653] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:56:59.512261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e94e20-c0fd-4b4f-8025-58433984acdc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:59.538526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e94e20-c0fd-4b4f-8025-58433984acdc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:59.564934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8af198-b638-409b-b32e-e054f690f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:59.567176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8af198-b638-409b-b32e-e054f690f639 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:59.567623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8af198-b638-409b-b32e-e054f690f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:59.568745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8af198-b638-409b-b32e-e054f690f639 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:59.575239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8af198-b638-409b-b32e-e054f690f639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:59.577580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8af198-b638-409b-b32e-e054f690f639 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:56:59.686185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683187f-4082-4f81-9715-b6d85b0c578a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:59.686471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683187f-4082-4f81-9715-b6d85b0c578a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:59.686817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683187f-4082-4f81-9715-b6d85b0c578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:59.712142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 821/1654] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:56:59 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:56:59.716924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8af198-b638-409b-b32e-e054f690f639 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:56:59.802108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a683187f-4082-4f81-9715-b6d85b0c578a None None] MFA Rules not processed for user `b35f3684e2e648148e1273ad6f7b7cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:56:59.810706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a683187f-4082-4f81-9715-b6d85b0c578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:56:59.927588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8af198-b638-409b-b32e-e054f690f639 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:56:59.955624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1996c-b77c-4267-b330-fd4b6250df01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:56:59.958902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1996c-b77c-4267-b330-fd4b6250df01 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:56:59.960946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1996c-b77c-4267-b330-fd4b6250df01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:56:59.962149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1996c-b77c-4267-b330-fd4b6250df01 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:56:59.966959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1996c-b77c-4267-b330-fd4b6250df01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:56:59.976189 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1996c-b77c-4267-b330-fd4b6250df01 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:00.062733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 834/1655] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:00.067112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 822/1656] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:56:59 2022] POST /identity/v3/users => generated 287 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:00.070625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683187f-4082-4f81-9715-b6d85b0c578a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:00.072206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1996c-b77c-4267-b330-fd4b6250df01 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:00.079648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-70e1996c-b77c-4267-b330-fd4b6250df01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:00.106685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683187f-4082-4f81-9715-b6d85b0c578a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:00.122578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212888-d100-4d92-a6fa-8ffd700f99c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:00.123465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212888-d100-4d92-a6fa-8ffd700f99c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:00.123755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212888-d100-4d92-a6fa-8ffd700f99c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:00.124028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212888-d100-4d92-a6fa-8ffd700f99c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:00.124839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a212888-d100-4d92-a6fa-8ffd700f99c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:00.135654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a212888-d100-4d92-a6fa-8ffd700f99c9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:00.181845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 835/1657] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:00.187228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212888-d100-4d92-a6fa-8ffd700f99c9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:00.223991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212888-d100-4d92-a6fa-8ffd700f99c9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:00.241649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e637c9-58d7-4e24-92a3-2477fa037afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:00.242338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e637c9-58d7-4e24-92a3-2477fa037afe admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:00.242616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e637c9-58d7-4e24-92a3-2477fa037afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:00.242886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e637c9-58d7-4e24-92a3-2477fa037afe admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:00.250232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e637c9-58d7-4e24-92a3-2477fa037afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:00.254909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e637c9-58d7-4e24-92a3-2477fa037afe admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:00.289191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 836/1658] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:00.293047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdcc78-6b53-4c60-ac2e-88e4c98875bc None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:00.314313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdcc78-6b53-4c60-ac2e-88e4c98875bc None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:00.316145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdcc78-6b53-4c60-ac2e-88e4c98875bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:00.357306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6ecdcc78-6b53-4c60-ac2e-88e4c98875bc None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:00.358728 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6ecdcc78-6b53-4c60-ac2e-88e4c98875bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:00.383640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1996c-b77c-4267-b330-fd4b6250df01 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:00.403313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac58ec8-ebd7-4dcc-8974-32abe943172d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:00.404535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58ec8-ebd7-4dcc-8974-32abe943172d service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:00.404827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58ec8-ebd7-4dcc-8974-32abe943172d service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:00.405109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58ec8-ebd7-4dcc-8974-32abe943172d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:00.425704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac58ec8-ebd7-4dcc-8974-32abe943172d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:00.430330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac58ec8-ebd7-4dcc-8974-32abe943172d service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:00.448869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 837/1659] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 18:57:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:00.451489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdcc78-6b53-4c60-ac2e-88e4c98875bc None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:00.455302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 823/1660] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:00.468930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdcc78-6b53-4c60-ac2e-88e4c98875bc None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:00.474907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff0705-892d-42a7-b76f-431e018da8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:00.475914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff0705-892d-42a7-b76f-431e018da8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:00.476294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff0705-892d-42a7-b76f-431e018da8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:00.476679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff0705-892d-42a7-b76f-431e018da8b9 admin admin] PATH_INFO: `/v3/projects/3628dba42bc944848d453102094218e1/users/b429c3428ba54da997410bd704597d11/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:00.498120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff0705-892d-42a7-b76f-431e018da8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3628dba42bc944848d453102094218e1, user_id=b429c3428ba54da997410bd704597d11, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:00.501587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff0705-892d-42a7-b76f-431e018da8b9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:00.524901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 838/1661] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:00 2022] PUT /identity/v3/projects/3628dba42bc944848d453102094218e1/users/b429c3428ba54da997410bd704597d11/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:00.537916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9196e-79c6-4bce-9259-8162ec34cdff None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:00.538733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9196e-79c6-4bce-9259-8162ec34cdff None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:00.538733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9196e-79c6-4bce-9259-8162ec34cdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:00.599591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-13c9196e-79c6-4bce-9259-8162ec34cdff None None] MFA Rules not processed for user `b429c3428ba54da997410bd704597d11`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:00.600951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-13c9196e-79c6-4bce-9259-8162ec34cdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:00.720389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 824/1662] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:00.725357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff0705-892d-42a7-b76f-431e018da8b9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:00.753813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9196e-79c6-4bce-9259-8162ec34cdff None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:00.755487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-13c9196e-79c6-4bce-9259-8162ec34cdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:00.855030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9196e-79c6-4bce-9259-8162ec34cdff None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:00.869985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff0705-892d-42a7-b76f-431e018da8b9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:00.871493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019f3d4-77de-436b-9f9f-678113f763c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:00.872731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019f3d4-77de-436b-9f9f-678113f763c0 service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:00.873236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019f3d4-77de-436b-9f9f-678113f763c0 service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:00.873950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019f3d4-77de-436b-9f9f-678113f763c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:00.889849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8ce11-488c-4d3a-bbd0-a824f289c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:00.893395 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8ce11-488c-4d3a-bbd0-a824f289c65e admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:00.894643 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8ce11-488c-4d3a-bbd0-a824f289c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:00.896320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8ce11-488c-4d3a-bbd0-a824f289c65e admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:00.897221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8ce11-488c-4d3a-bbd0-a824f289c65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:00.904803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8ce11-488c-4d3a-bbd0-a824f289c65e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:01.001481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 839/1663] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:00 2022] POST /identity/v3/projects => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:01.003921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8ce11-488c-4d3a-bbd0-a824f289c65e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:01.036930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019f3d4-77de-436b-9f9f-678113f763c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:01.040143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019f3d4-77de-436b-9f9f-678113f763c0 service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:01.061523 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 825/1664] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 18:57:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:57:01.155119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8ce11-488c-4d3a-bbd0-a824f289c65e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:01.161662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f6b7e-d2f3-47e0-b279-2c4c44a715c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:01.162792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f6b7e-d2f3-47e0-b279-2c4c44a715c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:01.163271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f6b7e-d2f3-47e0-b279-2c4c44a715c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:01.163733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f6b7e-d2f3-47e0-b279-2c4c44a715c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:01.164669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f6b7e-d2f3-47e0-b279-2c4c44a715c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:01.168035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f6b7e-d2f3-47e0-b279-2c4c44a715c1 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:01.223169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 840/1665] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:01 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:01.227236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019f3d4-77de-436b-9f9f-678113f763c0 service swift] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:01.247124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019f3d4-77de-436b-9f9f-678113f763c0 service swift] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:01.265089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c204c-f867-485d-a22f-68a9b8145bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:01.266244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c204c-f867-485d-a22f-68a9b8145bae admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:01.266667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c204c-f867-485d-a22f-68a9b8145bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:01.267078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c204c-f867-485d-a22f-68a9b8145bae admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:01.267961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c204c-f867-485d-a22f-68a9b8145bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:01.271784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c204c-f867-485d-a22f-68a9b8145bae admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:01.314471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 826/1666] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:01.318691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f6b7e-d2f3-47e0-b279-2c4c44a715c1 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:01.356334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f6b7e-d2f3-47e0-b279-2c4c44a715c1 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:01.373437 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31744136-0918-4141-8fab-db77bf221f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:01.381632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744136-0918-4141-8fab-db77bf221f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:01.381632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744136-0918-4141-8fab-db77bf221f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:01.381796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744136-0918-4141-8fab-db77bf221f48 admin admin] PATH_INFO: `/v3/projects/603200fe27254b3f8e63bddf9b15e4a0/users/f7707f4b3e1542198966e3626f5a82a0/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:01.466530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31744136-0918-4141-8fab-db77bf221f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603200fe27254b3f8e63bddf9b15e4a0, user_id=f7707f4b3e1542198966e3626f5a82a0, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:01.484489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31744136-0918-4141-8fab-db77bf221f48 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:01.521724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 841/1667] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:01 2022] PUT /identity/v3/projects/603200fe27254b3f8e63bddf9b15e4a0/users/f7707f4b3e1542198966e3626f5a82a0/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:01.527445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c204c-f867-485d-a22f-68a9b8145bae admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:01.545160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c204c-f867-485d-a22f-68a9b8145bae admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:01.784706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb48cf6-bb2a-49a7-8fdc-38baa9a1ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:01.787661 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb48cf6-bb2a-49a7-8fdc-38baa9a1ce99 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:01.787952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb48cf6-bb2a-49a7-8fdc-38baa9a1ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:01.792278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb48cf6-bb2a-49a7-8fdc-38baa9a1ce99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:01.794107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb48cf6-bb2a-49a7-8fdc-38baa9a1ce99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:01.802791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb48cf6-bb2a-49a7-8fdc-38baa9a1ce99 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:01.842766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31744136-0918-4141-8fab-db77bf221f48 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:01.853880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 827/1668] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:01.858188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31744136-0918-4141-8fab-db77bf221f48 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:01.879984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d497fe-1401-4d15-88da-c51819860488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:01.880900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d497fe-1401-4d15-88da-c51819860488 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:01.881752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d497fe-1401-4d15-88da-c51819860488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:01.882178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d497fe-1401-4d15-88da-c51819860488 admin admin] PATH_INFO: `/v3/projects/603200fe27254b3f8e63bddf9b15e4a0/users/f7707f4b3e1542198966e3626f5a82a0/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:01.889475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d497fe-1401-4d15-88da-c51819860488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603200fe27254b3f8e63bddf9b15e4a0, user_id=f7707f4b3e1542198966e3626f5a82a0, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:01.895977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d497fe-1401-4d15-88da-c51819860488 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:01.943515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d964-3201-4a9c-a379-4683255987d0 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:01.943515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d964-3201-4a9c-a379-4683255987d0 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:01.943515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d964-3201-4a9c-a379-4683255987d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:01.944665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 842/1669] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:01 2022] PUT /identity/v3/projects/603200fe27254b3f8e63bddf9b15e4a0/users/f7707f4b3e1542198966e3626f5a82a0/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:01.991594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-e659d964-3201-4a9c-a379-4683255987d0 None None] MFA Rules not processed for user `f7707f4b3e1542198966e3626f5a82a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:01.992949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e659d964-3201-4a9c-a379-4683255987d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:02.127352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 828/1670] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:02.132127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d497fe-1401-4d15-88da-c51819860488 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:02.134248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-11d497fe-1401-4d15-88da-c51819860488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:02.302608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d497fe-1401-4d15-88da-c51819860488 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:02.310150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd9b69-197f-40b9-8a29-b792215a138d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:02.310904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd9b69-197f-40b9-8a29-b792215a138d service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:02.311199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd9b69-197f-40b9-8a29-b792215a138d service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:02.312019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd9b69-197f-40b9-8a29-b792215a138d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:02.336825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd9b69-197f-40b9-8a29-b792215a138d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:02.338897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd9b69-197f-40b9-8a29-b792215a138d service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:02.351017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 843/1671] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:03.270613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659d964-3201-4a9c-a379-4683255987d0 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:03.433130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659d964-3201-4a9c-a379-4683255987d0 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:03.459409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:03.461089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:03.461404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:03.461688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] PATH_INFO: `/v3/users/b429c3428ba54da997410bd704597d11` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:03.471883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b429c3428ba54da997410bd704597d11)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:03.473651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:03.616481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b429c3428ba54da997410bd704597d11'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:03.639417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b429c3428ba54da997410bd704597d11'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:03.640856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b429c3428ba54da997410bd704597d11'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:03.642747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b429c3428ba54da997410bd704597d11'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:03.668322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b429c3428ba54da997410bd704597d11'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:03.724162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 829/1672] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:03 2022] DELETE /identity/v3/users/b429c3428ba54da997410bd704597d11 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:03.726430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a6cd3-89ab-4ab7-adf2-993b112519c9 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:03.726916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a6cd3-89ab-4ab7-adf2-993b112519c9 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:03.727161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a6cd3-89ab-4ab7-adf2-993b112519c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:03.806576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b96a6cd3-89ab-4ab7-adf2-993b112519c9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:03.808333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b96a6cd3-89ab-4ab7-adf2-993b112519c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:04.051689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 844/1673] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:04.114525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:04.116148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:04.123098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117ebfd-0a61-4b03-8fc4-8795d1a0f9bf None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:04.123735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117ebfd-0a61-4b03-8fc4-8795d1a0f9bf None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:04.124300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117ebfd-0a61-4b03-8fc4-8795d1a0f9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:04.166521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9117ebfd-0a61-4b03-8fc4-8795d1a0f9bf None None] MFA Rules not processed for user `94b338c27d664f51bc9de29c9c6ba40e`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:04.167785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9117ebfd-0a61-4b03-8fc4-8795d1a0f9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:04.230785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20cb6a-97ff-4da9-9e5d-de80c24d4f8d admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:04.242712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ef57b-bc04-4c5e-84b4-1a118943f4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:04.245565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ef57b-bc04-4c5e-84b4-1a118943f4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:04.247149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ef57b-bc04-4c5e-84b4-1a118943f4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:04.248665 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ef57b-bc04-4c5e-84b4-1a118943f4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:04.279651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ef57b-bc04-4c5e-84b4-1a118943f4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:04.282989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ef57b-bc04-4c5e-84b4-1a118943f4d5 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:04.299458 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 830/1674] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:04.354908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 845/1675] 10.222.0.55 () {58 vars in 1015 bytes} [Wed May 4 18:57:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:04.991642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ef57b-bc04-4c5e-84b4-1a118943f4d5 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:04.994190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a60ef57b-bc04-4c5e-84b4-1a118943f4d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:05.015246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ef57b-bc04-4c5e-84b4-1a118943f4d5 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:05.030374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b6bf9-6ad6-4497-b56a-499022bcb4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:05.031128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b6bf9-6ad6-4497-b56a-499022bcb4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:05.031478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b6bf9-6ad6-4497-b56a-499022bcb4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:05.032871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b6bf9-6ad6-4497-b56a-499022bcb4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:05.050681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b6bf9-6ad6-4497-b56a-499022bcb4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:05.055138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b6bf9-6ad6-4497-b56a-499022bcb4b6 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:05.093657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117ebfd-0a61-4b03-8fc4-8795d1a0f9bf None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:05.095501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9117ebfd-0a61-4b03-8fc4-8795d1a0f9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:05.099365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 831/1676] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:05.138680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117ebfd-0a61-4b03-8fc4-8795d1a0f9bf None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:05.153145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:05.156061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:05.157830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:05.159279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] PATH_INFO: `/v3/users/d8d86ea283454bf8a5379d86036941be` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:05.162546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d86ea283454bf8a5379d86036941be)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:05.167519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:05.357918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d86ea283454bf8a5379d86036941be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:05.377400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d86ea283454bf8a5379d86036941be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:05.380196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d86ea283454bf8a5379d86036941be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:05.381752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d86ea283454bf8a5379d86036941be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:05.405147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d86ea283454bf8a5379d86036941be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:05.430254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 846/1677] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:05 2022] DELETE /identity/v3/users/d8d86ea283454bf8a5379d86036941be => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:05.435675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb3c88-cefc-4f61-97c1-4384ada3b2be None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:05.436842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb3c88-cefc-4f61-97c1-4384ada3b2be None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:05.437467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb3c88-cefc-4f61-97c1-4384ada3b2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:05.488084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-f8eb3c88-cefc-4f61-97c1-4384ada3b2be None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:05.492349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f8eb3c88-cefc-4f61-97c1-4384ada3b2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:05.704994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 832/1678] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:05.727751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:05.729457 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:05.908451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e943e5-89f1-4379-b9b5-0d3f0b1215e9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:05.918467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db8253-6b6e-499f-9c52-21505db08ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:05.920468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db8253-6b6e-499f-9c52-21505db08ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:05.923823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db8253-6b6e-499f-9c52-21505db08ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:05.924303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db8253-6b6e-499f-9c52-21505db08ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:05.948993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db8253-6b6e-499f-9c52-21505db08ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:05.956856 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db8253-6b6e-499f-9c52-21505db08ff0 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:06.002001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 847/1679] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:57:06.317711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb3c88-cefc-4f61-97c1-4384ada3b2be None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:06.320307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f8eb3c88-cefc-4f61-97c1-4384ada3b2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:06.359637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb3c88-cefc-4f61-97c1-4384ada3b2be None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:06.385092 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:06.386919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:06.388957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:06.389451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] PATH_INFO: `/v3/projects/3628dba42bc944848d453102094218e1` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:06.392842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3628dba42bc944848d453102094218e1)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:06.398051 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:06.544128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3628dba42bc944848d453102094218e1', 'request_id': 'req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:06.558156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3628dba42bc944848d453102094218e1', 'request_id': 'req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:06.583785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3628dba42bc944848d453102094218e1', 'request_id': 'req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:06.602859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] The token cache is being invalidate because project 3628dba42bc944848d453102094218e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:06.603161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:06.607056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-12d7a0e7-7e67-4e21-9896-43f61ea5f7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:06.610674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 833/1680] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:06 2022] DELETE /identity/v3/projects/3628dba42bc944848d453102094218e1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:06.615531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db8253-6b6e-499f-9c52-21505db08ff0 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:06.626914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db8253-6b6e-499f-9c52-21505db08ff0 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:06.806568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:06.807624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:06.808105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:06.808192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] PATH_INFO: `/v3/users/f7707f4b3e1542198966e3626f5a82a0` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:06.811873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7707f4b3e1542198966e3626f5a82a0)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:06.827002 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:06.916514 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55f2b2-7640-4d9a-901b-2b63513c84f0 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:06.916846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55f2b2-7640-4d9a-901b-2b63513c84f0 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:06.917558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55f2b2-7640-4d9a-901b-2b63513c84f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:06.964834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-df55f2b2-7640-4d9a-901b-2b63513c84f0 None None] MFA Rules not processed for user `b35f3684e2e648148e1273ad6f7b7cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:06.974123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-df55f2b2-7640-4d9a-901b-2b63513c84f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:07.010070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7707f4b3e1542198966e3626f5a82a0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.031876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7707f4b3e1542198966e3626f5a82a0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.032702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7707f4b3e1542198966e3626f5a82a0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.035529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7707f4b3e1542198966e3626f5a82a0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.053679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7707f4b3e1542198966e3626f5a82a0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.104970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 848/1681] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:06 2022] DELETE /identity/v3/users/f7707f4b3e1542198966e3626f5a82a0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:07.158863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:07.161579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:07.188478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 834/1682] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:07.214203 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55f2b2-7640-4d9a-901b-2b63513c84f0 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:07.216047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-df55f2b2-7640-4d9a-901b-2b63513c84f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:07.254688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55f2b2-7640-4d9a-901b-2b63513c84f0 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:07.377493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:07.378647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:07.379150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:07.379649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] PATH_INFO: `/v3/users/37bdc8fd9f824937bf55ad43daae4787` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:07.383106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37bdc8fd9f824937bf55ad43daae4787)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:07.385417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:07.395958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a720114-93da-41a3-917a-432f56342d6c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:07.414181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:07.415330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:07.415621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:07.415900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] PATH_INFO: `/v3/users/c7f615e0c93b43ea8a3a74a8150c6e7f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:07.419499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f615e0c93b43ea8a3a74a8150c6e7f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:07.421554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:07.509899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37bdc8fd9f824937bf55ad43daae4787'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.526944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37bdc8fd9f824937bf55ad43daae4787'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.530367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37bdc8fd9f824937bf55ad43daae4787'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.532162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37bdc8fd9f824937bf55ad43daae4787'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.553856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37bdc8fd9f824937bf55ad43daae4787'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.569963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f615e0c93b43ea8a3a74a8150c6e7f'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.590657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f615e0c93b43ea8a3a74a8150c6e7f'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.595713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f615e0c93b43ea8a3a74a8150c6e7f'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.596018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f615e0c93b43ea8a3a74a8150c6e7f'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.602166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 835/1683] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:07 2022] DELETE /identity/v3/users/37bdc8fd9f824937bf55ad43daae4787 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:07.603446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:07.610479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:07.615760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c53e59a9-6c01-42ff-86ce-a8f10bda9a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f615e0c93b43ea8a3a74a8150c6e7f'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:07.656369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 849/1684] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:07 2022] DELETE /identity/v3/users/c7f615e0c93b43ea8a3a74a8150c6e7f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:07.657964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8edffc-d942-48a8-8355-409e48bbcd0e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:07.658252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8edffc-d942-48a8-8355-409e48bbcd0e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:07.658746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8edffc-d942-48a8-8355-409e48bbcd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:07.718513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-1c8edffc-d942-48a8-8355-409e48bbcd0e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:07.726089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1c8edffc-d942-48a8-8355-409e48bbcd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:07.762723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0354045-978e-4e38-92c3-d77a69d83f16 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:07.898646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:07.899759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:07.900261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:07.900721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] PATH_INFO: `/v3/projects/aa8f8387294749139d18c7dfc60e60b6` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:07.904453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8f8387294749139d18c7dfc60e60b6)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:07.906949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:07.946306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 850/1685] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:07.948076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d8efa-7253-439c-bea3-f0b0bc13272c None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:07.948374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d8efa-7253-439c-bea3-f0b0bc13272c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:07.948668 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d8efa-7253-439c-bea3-f0b0bc13272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:08.035147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-4c2d8efa-7253-439c-bea3-f0b0bc13272c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:08.036808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4c2d8efa-7253-439c-bea3-f0b0bc13272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:08.065381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8f8387294749139d18c7dfc60e60b6', 'request_id': 'req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:08.098365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8f8387294749139d18c7dfc60e60b6', 'request_id': 'req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:08.110492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8f8387294749139d18c7dfc60e60b6', 'request_id': 'req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:08.127177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] The token cache is being invalidate because project aa8f8387294749139d18c7dfc60e60b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:08.127744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:08.130399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:08.134113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 836/1686] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:07 2022] DELETE /identity/v3/projects/aa8f8387294749139d18c7dfc60e60b6 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:08.135125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:08.139058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:08.168867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 851/1687] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:08.170916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36253db-7d93-445d-9c4f-0f307f4c09dd None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:08.171595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36253db-7d93-445d-9c4f-0f307f4c09dd None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:08.172056 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36253db-7d93-445d-9c4f-0f307f4c09dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:08.206876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d36253db-7d93-445d-9c4f-0f307f4c09dd None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:08.209063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d36253db-7d93-445d-9c4f-0f307f4c09dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:08.222458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 852/1688] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:08.223962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36253db-7d93-445d-9c4f-0f307f4c09dd None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:08.235244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d36253db-7d93-445d-9c4f-0f307f4c09dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:08.258673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad82ef1-8a07-4dbe-96fe-343b0eaa7dd5 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:08.272746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08da5c-011e-4744-9452-1c0f5066b141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:08.273474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08da5c-011e-4744-9452-1c0f5066b141 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:08.273804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08da5c-011e-4744-9452-1c0f5066b141 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:08.274095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08da5c-011e-4744-9452-1c0f5066b141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:08.286310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ed08da5c-011e-4744-9452-1c0f5066b141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:08.312496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08da5c-011e-4744-9452-1c0f5066b141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:08.314022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08da5c-011e-4744-9452-1c0f5066b141 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:08.325216 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36253db-7d93-445d-9c4f-0f307f4c09dd None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:08.328774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 837/1689] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:08.330275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6c16e-c1b1-4737-8e89-7d78063e09eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:08.330401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b182a58-e0b3-4ac8-99ef-4824580222c7 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:08.330582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b182a58-e0b3-4ac8-99ef-4824580222c7 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:08.331057 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6c16e-c1b1-4737-8e89-7d78063e09eb service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:08.331335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b182a58-e0b3-4ac8-99ef-4824580222c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:08.331435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6c16e-c1b1-4737-8e89-7d78063e09eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:08.331730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6c16e-c1b1-4737-8e89-7d78063e09eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:08.343148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6c16e-c1b1-4737-8e89-7d78063e09eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:08.345158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6c16e-c1b1-4737-8e89-7d78063e09eb service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:08.358600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 853/1690] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:08.379687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3b182a58-e0b3-4ac8-99ef-4824580222c7 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:08.381355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3b182a58-e0b3-4ac8-99ef-4824580222c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:08.401590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 838/1691] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:08.405937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6c16e-c1b1-4737-8e89-7d78063e09eb service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:08.424297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6c16e-c1b1-4737-8e89-7d78063e09eb service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:08.497386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29119af-a39f-455c-a293-361d11a3b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:08.498419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29119af-a39f-455c-a293-361d11a3b208 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:08.498611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29119af-a39f-455c-a293-361d11a3b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:08.511375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29119af-a39f-455c-a293-361d11a3b208 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:08.514822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29119af-a39f-455c-a293-361d11a3b208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:08.515300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29119af-a39f-455c-a293-361d11a3b208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:08.529532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29119af-a39f-455c-a293-361d11a3b208 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:08.622335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 854/1692] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:57:08.627462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b182a58-e0b3-4ac8-99ef-4824580222c7 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:08.642501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b182a58-e0b3-4ac8-99ef-4824580222c7 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:08.663870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bc1ef-6f3c-4e68-b72f-1f640aed09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:08.667990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bc1ef-6f3c-4e68-b72f-1f640aed09ac admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:08.678036 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bc1ef-6f3c-4e68-b72f-1f640aed09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:08.679313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bc1ef-6f3c-4e68-b72f-1f640aed09ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:08.682633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bc1ef-6f3c-4e68-b72f-1f640aed09ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:08.693552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bc1ef-6f3c-4e68-b72f-1f640aed09ac admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:08.769194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 839/1693] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:08 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:57:08.780859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29119af-a39f-455c-a293-361d11a3b208 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:08.800584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29119af-a39f-455c-a293-361d11a3b208 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:09.026431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33bbfc-d0cc-455e-baf4-3984441b7ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:09.027135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33bbfc-d0cc-455e-baf4-3984441b7ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.027418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33bbfc-d0cc-455e-baf4-3984441b7ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.027690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33bbfc-d0cc-455e-baf4-3984441b7ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.028392 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33bbfc-d0cc-455e-baf4-3984441b7ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:09.030373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33bbfc-d0cc-455e-baf4-3984441b7ed6 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:09.097551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bc1ef-6f3c-4e68-b72f-1f640aed09ac admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:09.099524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-889bc1ef-6f3c-4e68-b72f-1f640aed09ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:09.129387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 855/1694] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:08 2022] POST /identity/v3/users => generated 287 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:09.130638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33bbfc-d0cc-455e-baf4-3984441b7ed6 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:09.131502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bc1ef-6f3c-4e68-b72f-1f640aed09ac admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:09.157816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:09.159024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.159461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.159883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] PATH_INFO: `/v3/projects/a42cb39e34c5497496e00c7a842cd3e5` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.168255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42cb39e34c5497496e00c7a842cd3e5)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:09.174082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:09.201967 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33bbfc-d0cc-455e-baf4-3984441b7ed6 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:09.226729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99766c3d-f6e8-450e-9ed4-2426e7679f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:09.242350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766c3d-f6e8-450e-9ed4-2426e7679f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.242749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766c3d-f6e8-450e-9ed4-2426e7679f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.243919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766c3d-f6e8-450e-9ed4-2426e7679f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.245885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99766c3d-f6e8-450e-9ed4-2426e7679f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:09.251225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99766c3d-f6e8-450e-9ed4-2426e7679f49 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:09.296155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 856/1695] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:09.309649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99766c3d-f6e8-450e-9ed4-2426e7679f49 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:09.332931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99766c3d-f6e8-450e-9ed4-2426e7679f49 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:09.356803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42cb39e34c5497496e00c7a842cd3e5', 'request_id': 'req-cb2a075f-c4d4-4134-abe2-4a25e357947b'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:09.382609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42cb39e34c5497496e00c7a842cd3e5', 'request_id': 'req-cb2a075f-c4d4-4134-abe2-4a25e357947b'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:09.407981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42cb39e34c5497496e00c7a842cd3e5', 'request_id': 'req-cb2a075f-c4d4-4134-abe2-4a25e357947b'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:09.436872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] The token cache is being invalidate because project a42cb39e34c5497496e00c7a842cd3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:09.437389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:09.438956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-cb2a075f-c4d4-4134-abe2-4a25e357947b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:09.442174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 840/1696] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:09 2022] DELETE /identity/v3/projects/a42cb39e34c5497496e00c7a842cd3e5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:09.454191 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30d125-99f8-413e-8619-7ae17ea4c3b6 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.454673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30d125-99f8-413e-8619-7ae17ea4c3b6 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.455095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30d125-99f8-413e-8619-7ae17ea4c3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.465518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d5cb-26c9-49c1-89b7-494e7e18aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:09.466587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d5cb-26c9-49c1-89b7-494e7e18aab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.467082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d5cb-26c9-49c1-89b7-494e7e18aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.467456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d5cb-26c9-49c1-89b7-494e7e18aab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.468300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d5cb-26c9-49c1-89b7-494e7e18aab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:09.473227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d5cb-26c9-49c1-89b7-494e7e18aab3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:09.502081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 857/1697] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:09.503042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d5cb-26c9-49c1-89b7-494e7e18aab3 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:09.509120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-eb30d125-99f8-413e-8619-7ae17ea4c3b6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:09.509474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d4a4d5cb-26c9-49c1-89b7-494e7e18aab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:09.510439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-eb30d125-99f8-413e-8619-7ae17ea4c3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:09.540506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d5cb-26c9-49c1-89b7-494e7e18aab3 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:09.543496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 841/1698] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:09.552077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365148b6-d0ab-4946-9825-ccdf6e81d245 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.552613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365148b6-d0ab-4946-9825-ccdf6e81d245 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.553062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365148b6-d0ab-4946-9825-ccdf6e81d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.554468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1f84-16a7-4bae-ab42-c94b1a119adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:09.555488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1f84-16a7-4bae-ab42-c94b1a119adb admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.555879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1f84-16a7-4bae-ab42-c94b1a119adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.556263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1f84-16a7-4bae-ab42-c94b1a119adb admin admin] PATH_INFO: `/v3/projects/9bc45121f4524abe808249c6e303758a/users/b6211a5ec32b467887e786f62881c9ee/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.597379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1f84-16a7-4bae-ab42-c94b1a119adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc45121f4524abe808249c6e303758a, user_id=b6211a5ec32b467887e786f62881c9ee, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:09.600388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1f84-16a7-4bae-ab42-c94b1a119adb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:09.609974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-365148b6-d0ab-4946-9825-ccdf6e81d245 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:09.611741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-365148b6-d0ab-4946-9825-ccdf6e81d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:09.642280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 858/1699] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:09 2022] PUT /identity/v3/projects/9bc45121f4524abe808249c6e303758a/users/b6211a5ec32b467887e786f62881c9ee/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:09.647215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b0e9b-c861-48df-8bb9-403993991741 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.648238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b0e9b-c861-48df-8bb9-403993991741 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.648615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b0e9b-c861-48df-8bb9-403993991741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.669232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 842/1700] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:09.678992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365148b6-d0ab-4946-9825-ccdf6e81d245 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:09.700713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a14b0e9b-c861-48df-8bb9-403993991741 None None] MFA Rules not processed for user `b6211a5ec32b467887e786f62881c9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:09.702086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a14b0e9b-c861-48df-8bb9-403993991741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:09.715755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365148b6-d0ab-4946-9825-ccdf6e81d245 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:09.780122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 859/1701] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:09.781118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b0e9b-c861-48df-8bb9-403993991741 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:09.858897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b0e9b-c861-48df-8bb9-403993991741 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:09.868428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ad6ed-a6a9-48df-951a-8b5ed5ac83be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:09.869391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ad6ed-a6a9-48df-951a-8b5ed5ac83be admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.869887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ad6ed-a6a9-48df-951a-8b5ed5ac83be admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.871357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ad6ed-a6a9-48df-951a-8b5ed5ac83be admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.872229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ad6ed-a6a9-48df-951a-8b5ed5ac83be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:09.882150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ad6ed-a6a9-48df-951a-8b5ed5ac83be admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:09.930415 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca3613-ef20-4e5a-ad17-1c45578fef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:09.930798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 860/1702] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:09 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:09.931668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca3613-ef20-4e5a-ad17-1c45578fef97 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:09.939044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ad6ed-a6a9-48df-951a-8b5ed5ac83be admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:09.939845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca3613-ef20-4e5a-ad17-1c45578fef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:09.942354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca3613-ef20-4e5a-ad17-1c45578fef97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:09.943512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca3613-ef20-4e5a-ad17-1c45578fef97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:09.944212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca3613-ef20-4e5a-ad17-1c45578fef97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:09.946876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca3613-ef20-4e5a-ad17-1c45578fef97 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:10.018146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 843/1703] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:10.022407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca3613-ef20-4e5a-ad17-1c45578fef97 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:10.051597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca3613-ef20-4e5a-ad17-1c45578fef97 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:10.160508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ad6ed-a6a9-48df-951a-8b5ed5ac83be admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:10.166588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9672fb-9cce-47e4-ad6b-57611fdc62d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:10.167501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9672fb-9cce-47e4-ad6b-57611fdc62d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:10.168027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9672fb-9cce-47e4-ad6b-57611fdc62d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:10.168638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9672fb-9cce-47e4-ad6b-57611fdc62d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:10.170018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9672fb-9cce-47e4-ad6b-57611fdc62d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:10.171767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9672fb-9cce-47e4-ad6b-57611fdc62d5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:10.225473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 861/1704] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:09 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:10.226402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9672fb-9cce-47e4-ad6b-57611fdc62d5 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:10.228317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cc9672fb-9cce-47e4-ad6b-57611fdc62d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:10.247163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9672fb-9cce-47e4-ad6b-57611fdc62d5 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:10.257535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:10.258385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:10.258706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:10.259033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] PATH_INFO: `/v3/projects/e3511ea328864fb782d9ded7da6e1b83` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:10.260504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3511ea328864fb782d9ded7da6e1b83)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:10.262769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:10.291539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d485d7-e0d9-47f8-85a2-065a19cde355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:10.292719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d485d7-e0d9-47f8-85a2-065a19cde355 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:10.293199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d485d7-e0d9-47f8-85a2-065a19cde355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:10.293914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d485d7-e0d9-47f8-85a2-065a19cde355 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:10.308491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d485d7-e0d9-47f8-85a2-065a19cde355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:10.310874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d485d7-e0d9-47f8-85a2-065a19cde355 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:10.371336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3511ea328864fb782d9ded7da6e1b83', 'request_id': 'req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.382240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 844/1705] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:10 2022] POST /identity/v3/projects => generated 365 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:10.387056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d485d7-e0d9-47f8-85a2-065a19cde355 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:10.392350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3511ea328864fb782d9ded7da6e1b83', 'request_id': 'req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.394167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-95d485d7-e0d9-47f8-85a2-065a19cde355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:10.402387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3511ea328864fb782d9ded7da6e1b83', 'request_id': 'req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.417119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] The token cache is being invalidate because project e3511ea328864fb782d9ded7da6e1b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:10.417729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.418960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.421316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 862/1706] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:10 2022] DELETE /identity/v3/projects/e3511ea328864fb782d9ded7da6e1b83 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:10.422004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:10.423379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:10.535165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5365-0175-4cc0-8fe7-77cd0ef1cf24 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:10.579192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d485d7-e0d9-47f8-85a2-065a19cde355 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:10.585641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:10.586539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:10.586919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:10.587430 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] PATH_INFO: `/v3/projects/603200fe27254b3f8e63bddf9b15e4a0` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:10.588807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=603200fe27254b3f8e63bddf9b15e4a0)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:10.590879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:10.663011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc70a1e-4f4f-49fa-a540-b39e5eb00031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:10.665407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc70a1e-4f4f-49fa-a540-b39e5eb00031 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:10.666051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc70a1e-4f4f-49fa-a540-b39e5eb00031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:10.666585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc70a1e-4f4f-49fa-a540-b39e5eb00031 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:10.675294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc70a1e-4f4f-49fa-a540-b39e5eb00031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:10.681796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc70a1e-4f4f-49fa-a540-b39e5eb00031 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:10.706311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 863/1707] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:10.707433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc70a1e-4f4f-49fa-a540-b39e5eb00031 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:10.710058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603200fe27254b3f8e63bddf9b15e4a0', 'request_id': 'req-a77c0cb5-95bc-4fce-bb69-12626682f076'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.721048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4cc70a1e-4f4f-49fa-a540-b39e5eb00031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:10.729462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603200fe27254b3f8e63bddf9b15e4a0', 'request_id': 'req-a77c0cb5-95bc-4fce-bb69-12626682f076'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.779084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603200fe27254b3f8e63bddf9b15e4a0', 'request_id': 'req-a77c0cb5-95bc-4fce-bb69-12626682f076'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.785342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc70a1e-4f4f-49fa-a540-b39e5eb00031 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:10.841366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] The token cache is being invalidate because project 603200fe27254b3f8e63bddf9b15e4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:10.841620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.843620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:10.852691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 845/1708] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:10 2022] DELETE /identity/v3/projects/603200fe27254b3f8e63bddf9b15e4a0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:10.853761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:10.873412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:11.030479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399faaf-9eb2-455e-9cbd-ab58d182890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:11.031178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399faaf-9eb2-455e-9cbd-ab58d182890a admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.031460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399faaf-9eb2-455e-9cbd-ab58d182890a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.031735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399faaf-9eb2-455e-9cbd-ab58d182890a admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.032445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399faaf-9eb2-455e-9cbd-ab58d182890a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:11.034423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399faaf-9eb2-455e-9cbd-ab58d182890a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:11.083355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c0cb5-95bc-4fce-bb69-12626682f076 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:11.090173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:11.091204 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.091559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.092038 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] PATH_INFO: `/v3/users/989c3094c0da431aaeae817e89bf7261` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.094095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=989c3094c0da431aaeae817e89bf7261)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:11.097830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:11.112968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 864/1709] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:10 2022] POST /identity/v3/users => generated 283 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:11.113861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399faaf-9eb2-455e-9cbd-ab58d182890a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:11.139237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0399faaf-9eb2-455e-9cbd-ab58d182890a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:11.199838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399faaf-9eb2-455e-9cbd-ab58d182890a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:11.219313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b53a2-d1e9-490d-b5ab-52281a199df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:11.220436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b53a2-d1e9-490d-b5ab-52281a199df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.220740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b53a2-d1e9-490d-b5ab-52281a199df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.221015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b53a2-d1e9-490d-b5ab-52281a199df1 admin admin] PATH_INFO: `/v3/projects/479a4a7ac72443b3889989a7de32d081/users/6432308ccb6f4a1b9ab450875ef04c73/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.254560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989c3094c0da431aaeae817e89bf7261'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:11.271397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b53a2-d1e9-490d-b5ab-52281a199df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479a4a7ac72443b3889989a7de32d081, user_id=6432308ccb6f4a1b9ab450875ef04c73, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:11.277247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989c3094c0da431aaeae817e89bf7261'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:11.277862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b53a2-d1e9-490d-b5ab-52281a199df1 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:11.291590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989c3094c0da431aaeae817e89bf7261'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:11.294728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989c3094c0da431aaeae817e89bf7261'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:11.316942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989c3094c0da431aaeae817e89bf7261'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:11.333660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 865/1710] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:11 2022] PUT /identity/v3/projects/479a4a7ac72443b3889989a7de32d081/users/6432308ccb6f4a1b9ab450875ef04c73/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:11.336101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184c046-5bd7-44e4-af7e-dafe64188a4b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.336589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184c046-5bd7-44e4-af7e-dafe64188a4b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.337316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184c046-5bd7-44e4-af7e-dafe64188a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.384680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 846/1711] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:10 2022] DELETE /identity/v3/users/989c3094c0da431aaeae817e89bf7261 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:11.385320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:11.388161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:11.408339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9184c046-5bd7-44e4-af7e-dafe64188a4b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:11.411748 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9184c046-5bd7-44e4-af7e-dafe64188a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:11.648690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455cb56-4776-4e70-80b7-4591fbebd37f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:11.650110 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 866/1712] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:11.651571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184c046-5bd7-44e4-af7e-dafe64188a4b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:11.653689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9184c046-5bd7-44e4-af7e-dafe64188a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:11.665977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a04b5-b840-4e2e-8141-236855604eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:11.669649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a04b5-b840-4e2e-8141-236855604eeb admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.669649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a04b5-b840-4e2e-8141-236855604eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.669649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a04b5-b840-4e2e-8141-236855604eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.669649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a04b5-b840-4e2e-8141-236855604eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:11.676301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a04b5-b840-4e2e-8141-236855604eeb admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:11.691225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184c046-5bd7-44e4-af7e-dafe64188a4b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:11.706057 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988945e-27b5-4cc0-adc9-2541d885a2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:11.706877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988945e-27b5-4cc0-adc9-2541d885a2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.707165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988945e-27b5-4cc0-adc9-2541d885a2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.707490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988945e-27b5-4cc0-adc9-2541d885a2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.708253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988945e-27b5-4cc0-adc9-2541d885a2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:11.716638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988945e-27b5-4cc0-adc9-2541d885a2e5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:11.744863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 867/1713] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:11.750366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf247ce-6128-4a2e-b917-034fbf5e4775 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.751545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf247ce-6128-4a2e-b917-034fbf5e4775 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.751802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf247ce-6128-4a2e-b917-034fbf5e4775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.754583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 847/1714] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:11.755641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a04b5-b840-4e2e-8141-236855604eeb admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:11.798757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a04b5-b840-4e2e-8141-236855604eeb admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:11.800587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5bf247ce-6128-4a2e-b917-034fbf5e4775 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:11.801858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5bf247ce-6128-4a2e-b917-034fbf5e4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:11.814736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f265c7-d423-4150-92dd-c9c70be398b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:11.818039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f265c7-d423-4150-92dd-c9c70be398b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.818334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f265c7-d423-4150-92dd-c9c70be398b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.818612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f265c7-d423-4150-92dd-c9c70be398b6 admin admin] PATH_INFO: `/v3/projects/479a4a7ac72443b3889989a7de32d081/users/6432308ccb6f4a1b9ab450875ef04c73/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.823474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 868/1715] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:11.824443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf247ce-6128-4a2e-b917-034fbf5e4775 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:11.836533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f265c7-d423-4150-92dd-c9c70be398b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479a4a7ac72443b3889989a7de32d081, user_id=6432308ccb6f4a1b9ab450875ef04c73, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:11.845932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f265c7-d423-4150-92dd-c9c70be398b6 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:11.850820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf247ce-6128-4a2e-b917-034fbf5e4775 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:11.871141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e35313-9f53-4d75-bc13-3c30b35d2373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:11.872133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e35313-9f53-4d75-bc13-3c30b35d2373 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.872420 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e35313-9f53-4d75-bc13-3c30b35d2373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.872698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e35313-9f53-4d75-bc13-3c30b35d2373 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.881241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e35313-9f53-4d75-bc13-3c30b35d2373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:11.881241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e35313-9f53-4d75-bc13-3c30b35d2373 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:11.892023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 848/1716] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:11 2022] PUT /identity/v3/projects/479a4a7ac72443b3889989a7de32d081/users/6432308ccb6f4a1b9ab450875ef04c73/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:11.892942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f265c7-d423-4150-92dd-c9c70be398b6 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:11.898799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 869/1717] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:11.907373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ec6f1-1328-4fbf-b6ad-f6f4f415a517 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:11.907704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ec6f1-1328-4fbf-b6ad-f6f4f415a517 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:11.908009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ec6f1-1328-4fbf-b6ad-f6f4f415a517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:11.997834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c36ec6f1-1328-4fbf-b6ad-f6f4f415a517 None None] MFA Rules not processed for user `6432308ccb6f4a1b9ab450875ef04c73`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:11.999223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c36ec6f1-1328-4fbf-b6ad-f6f4f415a517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:12.176354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f265c7-d423-4150-92dd-c9c70be398b6 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:12.189990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:12.190778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:12.191068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:12.191385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:12.199610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:12.199977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:12.201801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:12.238016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 870/1718] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:12.239384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ec6f1-1328-4fbf-b6ad-f6f4f415a517 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:12.254180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 849/1719] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:12.255397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:12.261864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:12.271494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ec6f1-1328-4fbf-b6ad-f6f4f415a517 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:12.287956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7c269-1818-4298-b86f-25f619524f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:12.288959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c269-1818-4298-b86f-25f619524f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:12.289265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c269-1818-4298-b86f-25f619524f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:12.289586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c269-1818-4298-b86f-25f619524f46 admin admin] PATH_INFO: `/v3/projects/dce88c9df2d94837bc6b499c194209f3/users/7355f42b7e9d40cfb26854562f85718c/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:12.293801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a23a5f-57e1-422b-8635-81cdda5ad7e7 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:12.310890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:12.311797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:12.312113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:12.314493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] PATH_INFO: `/v3/projects/a68d04323fdb475db78c7642694fdaec` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:12.315500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68d04323fdb475db78c7642694fdaec)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:12.320134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:12.358914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c269-1818-4298-b86f-25f619524f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce88c9df2d94837bc6b499c194209f3, user_id=7355f42b7e9d40cfb26854562f85718c, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:12.370366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c269-1818-4298-b86f-25f619524f46 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:12.413163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 871/1720] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:12 2022] PUT /identity/v3/projects/dce88c9df2d94837bc6b499c194209f3/users/7355f42b7e9d40cfb26854562f85718c/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:12.414583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3347a-55bb-4238-b059-58ccceda713b None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:12.414875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3347a-55bb-4238-b059-58ccceda713b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:12.415166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3347a-55bb-4238-b059-58ccceda713b None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:12.416689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 872/1721] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 18:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:57:12.417234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3347a-55bb-4238-b059-58ccceda713b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:12.431517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0cb3347a-55bb-4238-b059-58ccceda713b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:12.524591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68d04323fdb475db78c7642694fdaec', 'request_id': 'req-9aeea048-deb0-4863-be20-8d4ec532f7fc'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:12.558096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68d04323fdb475db78c7642694fdaec', 'request_id': 'req-9aeea048-deb0-4863-be20-8d4ec532f7fc'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:12.580888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68d04323fdb475db78c7642694fdaec', 'request_id': 'req-9aeea048-deb0-4863-be20-8d4ec532f7fc'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:12.607461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3347a-55bb-4238-b059-58ccceda713b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:12.608533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] The token cache is being invalidate because project a68d04323fdb475db78c7642694fdaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:12.608926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:12.611044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:12.618156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 850/1722] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:12 2022] DELETE /identity/v3/projects/a68d04323fdb475db78c7642694fdaec => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:12.619374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:12.637250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:12.776076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea048-deb0-4863-be20-8d4ec532f7fc admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:12.781787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9ade8-3f73-4c6f-8f6e-6931636bfccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:12.782591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ade8-3f73-4c6f-8f6e-6931636bfccb admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:12.782977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ade8-3f73-4c6f-8f6e-6931636bfccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:12.783355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ade8-3f73-4c6f-8f6e-6931636bfccb admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:12.784187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9ade8-3f73-4c6f-8f6e-6931636bfccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:12.796226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9ade8-3f73-4c6f-8f6e-6931636bfccb admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:12.796947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ab9da-377b-48ac-850c-6e6672581e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:12.797641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ab9da-377b-48ac-850c-6e6672581e66 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:12.797924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ab9da-377b-48ac-850c-6e6672581e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:12.798198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ab9da-377b-48ac-850c-6e6672581e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:12.804430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6b3ab9da-377b-48ac-850c-6e6672581e66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:12.876571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 851/1723] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:12 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:12.888219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de801ebc-9a1b-46c5-b76a-128347da09dc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:12.890267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de801ebc-9a1b-46c5-b76a-128347da09dc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:12.892738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de801ebc-9a1b-46c5-b76a-128347da09dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:12.976753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ab9da-377b-48ac-850c-6e6672581e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:12.978583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ab9da-377b-48ac-850c-6e6672581e66 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:12.981271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-de801ebc-9a1b-46c5-b76a-128347da09dc None None] MFA Rules not processed for user `7355f42b7e9d40cfb26854562f85718c`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:12.982739 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-de801ebc-9a1b-46c5-b76a-128347da09dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:12.992334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 873/1724] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:12.993817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b66d1c-0e93-4f2d-9a84-503dbdd72d4f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:12.994108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b66d1c-0e93-4f2d-9a84-503dbdd72d4f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:12.994422 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b66d1c-0e93-4f2d-9a84-503dbdd72d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:13.044841 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b7b66d1c-0e93-4f2d-9a84-503dbdd72d4f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:13.046537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b7b66d1c-0e93-4f2d-9a84-503dbdd72d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:13.132802 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 852/1725] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:13.137261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bec46-b37e-4530-b108-a02693a43c74 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:13.137742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bec46-b37e-4530-b108-a02693a43c74 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:13.138115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bec46-b37e-4530-b108-a02693a43c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:13.177659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9c8bec46-b37e-4530-b108-a02693a43c74 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:13.179133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9c8bec46-b37e-4530-b108-a02693a43c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:13.182495 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 874/1726] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:13.183696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b66d1c-0e93-4f2d-9a84-503dbdd72d4f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:13.194751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b66d1c-0e93-4f2d-9a84-503dbdd72d4f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:13.202433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ec3e8-96c8-4818-a6ec-4a63af8ffe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:13.204186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec3e8-96c8-4818-a6ec-4a63af8ffe27 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:13.204635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec3e8-96c8-4818-a6ec-4a63af8ffe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:13.205057 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ec3e8-96c8-4818-a6ec-4a63af8ffe27 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:13.206433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ec3e8-96c8-4818-a6ec-4a63af8ffe27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:13.213577 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ec3e8-96c8-4818-a6ec-4a63af8ffe27 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:13.267046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 875/1727] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:13 2022] POST /identity/v3/users => generated 293 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:13.274760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ec3e8-96c8-4818-a6ec-4a63af8ffe27 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:13.279689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-136ec3e8-96c8-4818-a6ec-4a63af8ffe27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:13.311798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ec3e8-96c8-4818-a6ec-4a63af8ffe27 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:13.318758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 853/1728] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 18:57:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:13.319830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bec46-b37e-4530-b108-a02693a43c74 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:13.321452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9c8bec46-b37e-4530-b108-a02693a43c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:13.323845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34cec1-a342-440a-a7a9-6e47ab931b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:13.324254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34cec1-a342-440a-a7a9-6e47ab931b7e admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:13.324578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34cec1-a342-440a-a7a9-6e47ab931b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:13.324804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34cec1-a342-440a-a7a9-6e47ab931b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:13.325538 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34cec1-a342-440a-a7a9-6e47ab931b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:13.327530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34cec1-a342-440a-a7a9-6e47ab931b7e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:13.399823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 876/1729] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:13 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:13.401960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50599810-bab0-44c6-a5fa-b8b5d2d1a314 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:13.402251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50599810-bab0-44c6-a5fa-b8b5d2d1a314 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:13.402526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50599810-bab0-44c6-a5fa-b8b5d2d1a314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:13.460164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-50599810-bab0-44c6-a5fa-b8b5d2d1a314 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:13.463679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-50599810-bab0-44c6-a5fa-b8b5d2d1a314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:13.509953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bec46-b37e-4530-b108-a02693a43c74 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:13.607231 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730657b-f362-49c3-8c78-ceb01b174d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:13.607762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730657b-f362-49c3-8c78-ceb01b174d23 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:13.608121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730657b-f362-49c3-8c78-ceb01b174d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:13.608328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730657b-f362-49c3-8c78-ceb01b174d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:13.621195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0730657b-f362-49c3-8c78-ceb01b174d23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:13.641376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 877/1730] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:13.642405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50599810-bab0-44c6-a5fa-b8b5d2d1a314 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:13.682835 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50599810-bab0-44c6-a5fa-b8b5d2d1a314 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:13.688155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78a64b-df06-46c7-9649-f4e83bc5c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:13.689045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a64b-df06-46c7-9649-f4e83bc5c0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:13.689729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a64b-df06-46c7-9649-f4e83bc5c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:13.690189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a64b-df06-46c7-9649-f4e83bc5c0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:13.691153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78a64b-df06-46c7-9649-f4e83bc5c0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:13.692995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78a64b-df06-46c7-9649-f4e83bc5c0e9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:13.709397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 878/1731] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:13.710833 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78a64b-df06-46c7-9649-f4e83bc5c0e9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:13.714839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9e78a64b-df06-46c7-9649-f4e83bc5c0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:13.769915 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730657b-f362-49c3-8c78-ceb01b174d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:13.771791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730657b-f362-49c3-8c78-ceb01b174d23 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:13.787008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 854/1732] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:13.787856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730657b-f362-49c3-8c78-ceb01b174d23 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:13.798912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730657b-f362-49c3-8c78-ceb01b174d23 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:13.805392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f0835-6235-471a-9e64-df9c021e7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:13.806343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f0835-6235-471a-9e64-df9c021e7738 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:13.806343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f0835-6235-471a-9e64-df9c021e7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:13.806650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f0835-6235-471a-9e64-df9c021e7738 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:13.807621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f0835-6235-471a-9e64-df9c021e7738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:13.809333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f0835-6235-471a-9e64-df9c021e7738 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:13.877376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 855/1733] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:13 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:13.887174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f0835-6235-471a-9e64-df9c021e7738 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:13.918852 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f0835-6235-471a-9e64-df9c021e7738 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:13.932547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c93c-840a-4fe8-8f9f-7f94fa259494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:13.933319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c93c-840a-4fe8-8f9f-7f94fa259494 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:13.933652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c93c-840a-4fe8-8f9f-7f94fa259494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:13.933976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c93c-840a-4fe8-8f9f-7f94fa259494 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:13.935075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c93c-840a-4fe8-8f9f-7f94fa259494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:13.937646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c93c-840a-4fe8-8f9f-7f94fa259494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:13.940535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c93c-840a-4fe8-8f9f-7f94fa259494 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:13.971864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 856/1734] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:13.972814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c93c-840a-4fe8-8f9f-7f94fa259494 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:13.995425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78a64b-df06-46c7-9649-f4e83bc5c0e9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:14.002786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c93c-840a-4fe8-8f9f-7f94fa259494 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:14.017676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e93fde-789b-4a1d-8355-697a8be0d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:14.018529 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e93fde-789b-4a1d-8355-697a8be0d3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.018868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e93fde-789b-4a1d-8355-697a8be0d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.019242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e93fde-789b-4a1d-8355-697a8be0d3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.020954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e93fde-789b-4a1d-8355-697a8be0d3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:14.021676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2461e-bdf4-475e-94dd-950fdd0455b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:14.022636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e93fde-789b-4a1d-8355-697a8be0d3d2 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:14.023676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2461e-bdf4-475e-94dd-950fdd0455b4 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.025278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2461e-bdf4-475e-94dd-950fdd0455b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.026302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2461e-bdf4-475e-94dd-950fdd0455b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.057854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 857/1735] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:14.058863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e93fde-789b-4a1d-8355-697a8be0d3d2 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:14.059818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2461e-bdf4-475e-94dd-950fdd0455b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:14.061706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2461e-bdf4-475e-94dd-950fdd0455b4 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:14.092923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e93fde-789b-4a1d-8355-697a8be0d3d2 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:14.109261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b9022-cea9-41b1-b759-111848bccef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:14.109985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b9022-cea9-41b1-b759-111848bccef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.110264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b9022-cea9-41b1-b759-111848bccef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.110537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b9022-cea9-41b1-b759-111848bccef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.114133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 879/1736] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:14.117035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2461e-bdf4-475e-94dd-950fdd0455b4 service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:14.128165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b9022-cea9-41b1-b759-111848bccef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:14.134424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b9022-cea9-41b1-b759-111848bccef3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:14.167247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2461e-bdf4-475e-94dd-950fdd0455b4 service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:14.172271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 858/1737] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:14.174101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b9022-cea9-41b1-b759-111848bccef3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:14.179776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14aa894-ce24-4e82-8e95-952964bf417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:14.180681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aa894-ce24-4e82-8e95-952964bf417b admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.181025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aa894-ce24-4e82-8e95-952964bf417b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.184278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aa894-ce24-4e82-8e95-952964bf417b admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.185157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14aa894-ce24-4e82-8e95-952964bf417b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:14.195871 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14aa894-ce24-4e82-8e95-952964bf417b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:14.197136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b9022-cea9-41b1-b759-111848bccef3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:14.211542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57099f0-a3d8-4b39-8444-1b24ad5e1f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:14.214508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57099f0-a3d8-4b39-8444-1b24ad5e1f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.214803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57099f0-a3d8-4b39-8444-1b24ad5e1f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.218263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57099f0-a3d8-4b39-8444-1b24ad5e1f54 admin admin] PATH_INFO: `/v3/projects/d0d329a7a66046fabe56fdca5eadadc5/users/4c5924ea4b1941bfaf141f7aa7d35325/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.259651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57099f0-a3d8-4b39-8444-1b24ad5e1f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d329a7a66046fabe56fdca5eadadc5, user_id=4c5924ea4b1941bfaf141f7aa7d35325, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:14.262634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57099f0-a3d8-4b39-8444-1b24ad5e1f54 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:14.304125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 880/1738] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:14 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:14.305106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14aa894-ce24-4e82-8e95-952964bf417b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:14.317309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 859/1739] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:14 2022] PUT /identity/v3/projects/d0d329a7a66046fabe56fdca5eadadc5/users/4c5924ea4b1941bfaf141f7aa7d35325/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:14.317309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57099f0-a3d8-4b39-8444-1b24ad5e1f54 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:14.426794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57099f0-a3d8-4b39-8444-1b24ad5e1f54 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:14.439160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14aa894-ce24-4e82-8e95-952964bf417b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:14.445475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092e4f5-b1d5-41b3-89ba-8ff0c5bc55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:14.446385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092e4f5-b1d5-41b3-89ba-8ff0c5bc55fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.446666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092e4f5-b1d5-41b3-89ba-8ff0c5bc55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.446936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092e4f5-b1d5-41b3-89ba-8ff0c5bc55fb admin admin] PATH_INFO: `/v3/projects/630541d7c09841dfba8202c72236fa1d/users/87489e19ebd44e8eb8f1fc100c911da7/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.470128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092e4f5-b1d5-41b3-89ba-8ff0c5bc55fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=630541d7c09841dfba8202c72236fa1d, user_id=87489e19ebd44e8eb8f1fc100c911da7, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:14.474099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092e4f5-b1d5-41b3-89ba-8ff0c5bc55fb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:14.523277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346e248-32b7-45d2-8c60-6161c0013a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:14.524141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346e248-32b7-45d2-8c60-6161c0013a38 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.524497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346e248-32b7-45d2-8c60-6161c0013a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.524830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346e248-32b7-45d2-8c60-6161c0013a38 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.525622 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346e248-32b7-45d2-8c60-6161c0013a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:14.529766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346e248-32b7-45d2-8c60-6161c0013a38 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:14.533477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 881/1740] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:14 2022] PUT /identity/v3/projects/630541d7c09841dfba8202c72236fa1d/users/87489e19ebd44e8eb8f1fc100c911da7/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:14.534713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351446-6c66-484a-92fe-7e31ba9b689a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.535025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351446-6c66-484a-92fe-7e31ba9b689a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.535300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351446-6c66-484a-92fe-7e31ba9b689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.565241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9f351446-6c66-484a-92fe-7e31ba9b689a None None] MFA Rules not processed for user `4c5924ea4b1941bfaf141f7aa7d35325`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:14.566636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9f351446-6c66-484a-92fe-7e31ba9b689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:14.586752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 860/1741] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:14 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:14.588271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966f2cf-c9c0-4c55-9bfe-073fa067ac66 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.588567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966f2cf-c9c0-4c55-9bfe-073fa067ac66 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.589060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966f2cf-c9c0-4c55-9bfe-073fa067ac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.653465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8966f2cf-c9c0-4c55-9bfe-073fa067ac66 None None] MFA Rules not processed for user `c6dc233a47d74b4f87ba15d414f1922d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:14.654691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8966f2cf-c9c0-4c55-9bfe-073fa067ac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:14.662028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 882/1742] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:14.664414 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51680a-896e-4a99-b511-3a2bb8bb0b17 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.667464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51680a-896e-4a99-b511-3a2bb8bb0b17 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.668123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51680a-896e-4a99-b511-3a2bb8bb0b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.745310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-de51680a-896e-4a99-b511-3a2bb8bb0b17 None None] MFA Rules not processed for user `c983699bd73f41fc813c41c498261ece`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:14.745310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-de51680a-896e-4a99-b511-3a2bb8bb0b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:14.852157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 883/1743] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:14.859166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51680a-896e-4a99-b511-3a2bb8bb0b17 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:14.863784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 861/1744] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:14.875363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966f2cf-c9c0-4c55-9bfe-073fa067ac66 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:14.930526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51680a-896e-4a99-b511-3a2bb8bb0b17 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:14.935637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070dce0-57fd-445b-ab04-177a3f85438c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:14.936496 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070dce0-57fd-445b-ab04-177a3f85438c admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.936795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070dce0-57fd-445b-ab04-177a3f85438c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.937074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070dce0-57fd-445b-ab04-177a3f85438c admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.938080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070dce0-57fd-445b-ab04-177a3f85438c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:14.939844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070dce0-57fd-445b-ab04-177a3f85438c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:14.953887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 884/1745] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:14.954550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070dce0-57fd-445b-ab04-177a3f85438c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:14.968294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070dce0-57fd-445b-ab04-177a3f85438c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:14.974752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7358054-1514-4698-9a60-df73fc6e3054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:14.975500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7358054-1514-4698-9a60-df73fc6e3054 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:14.975788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7358054-1514-4698-9a60-df73fc6e3054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:14.976214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7358054-1514-4698-9a60-df73fc6e3054 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:14.977371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7358054-1514-4698-9a60-df73fc6e3054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:14.980301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7358054-1514-4698-9a60-df73fc6e3054 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:15.014572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966f2cf-c9c0-4c55-9bfe-073fa067ac66 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:15.027944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 885/1746] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:14 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:15.029733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7358054-1514-4698-9a60-df73fc6e3054 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:15.032431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43b010-7697-4408-841b-fbe90cd3fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:15.033249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b010-7697-4408-841b-fbe90cd3fa5c admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.033746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b010-7697-4408-841b-fbe90cd3fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.034044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43b010-7697-4408-841b-fbe90cd3fa5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:15.034784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43b010-7697-4408-841b-fbe90cd3fa5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:15.036509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43b010-7697-4408-841b-fbe90cd3fa5c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:15.039620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c7358054-1514-4698-9a60-df73fc6e3054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:15.064382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 862/1747] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:15.065480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14625-79af-400d-a57f-ee6685696576 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.065765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14625-79af-400d-a57f-ee6685696576 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.066046 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14625-79af-400d-a57f-ee6685696576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:15.086678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-e6f14625-79af-400d-a57f-ee6685696576 None None] MFA Rules not processed for user `c6dc233a47d74b4f87ba15d414f1922d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:15.087696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e6f14625-79af-400d-a57f-ee6685696576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:15.149574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 863/1748] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:15.154900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14625-79af-400d-a57f-ee6685696576 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:15.195022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7358054-1514-4698-9a60-df73fc6e3054 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:15.212609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c54b-4d44-45d6-aae4-0df96a25d6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:15.213270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c54b-4d44-45d6-aae4-0df96a25d6ee service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.213585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c54b-4d44-45d6-aae4-0df96a25d6ee service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.213853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c54b-4d44-45d6-aae4-0df96a25d6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:15.295304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14625-79af-400d-a57f-ee6685696576 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:15.304300 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a2400-0a84-47c1-8575-ed2d33cb2890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:15.305302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a2400-0a84-47c1-8575-ed2d33cb2890 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.305581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a2400-0a84-47c1-8575-ed2d33cb2890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.305857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a2400-0a84-47c1-8575-ed2d33cb2890 admin admin] PATH_INFO: `/v3/projects/630541d7c09841dfba8202c72236fa1d/users/87489e19ebd44e8eb8f1fc100c911da7/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:15.310516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a2400-0a84-47c1-8575-ed2d33cb2890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630541d7c09841dfba8202c72236fa1d, user_id=87489e19ebd44e8eb8f1fc100c911da7, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:15.315994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a2400-0a84-47c1-8575-ed2d33cb2890 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:15.326386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89c54b-4d44-45d6-aae4-0df96a25d6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:15.328166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89c54b-4d44-45d6-aae4-0df96a25d6ee service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:15.341972 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 864/1749] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:15 2022] PUT /identity/v3/projects/630541d7c09841dfba8202c72236fa1d/users/87489e19ebd44e8eb8f1fc100c911da7/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:15.342742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a2400-0a84-47c1-8575-ed2d33cb2890 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:15.351045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 886/1750] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:15.353159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c54b-4d44-45d6-aae4-0df96a25d6ee service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:15.373223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89c54b-4d44-45d6-aae4-0df96a25d6ee service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:15.462162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a2400-0a84-47c1-8575-ed2d33cb2890 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:15.470493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779fbff-cbe9-4f71-b210-d9414219b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:15.471429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779fbff-cbe9-4f71-b210-d9414219b9fa admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.472097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779fbff-cbe9-4f71-b210-d9414219b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.473006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779fbff-cbe9-4f71-b210-d9414219b9fa admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:15.475959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779fbff-cbe9-4f71-b210-d9414219b9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:15.478336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779fbff-cbe9-4f71-b210-d9414219b9fa admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:15.506346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aef4b-8c73-4a2c-b972-c508b80b052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:15.507355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aef4b-8c73-4a2c-b972-c508b80b052c admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.507711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aef4b-8c73-4a2c-b972-c508b80b052c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.508201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aef4b-8c73-4a2c-b972-c508b80b052c admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:15.508943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aef4b-8c73-4a2c-b972-c508b80b052c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:15.513984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aef4b-8c73-4a2c-b972-c508b80b052c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:15.520860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 865/1751] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:15 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:15.521502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779fbff-cbe9-4f71-b210-d9414219b9fa admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:15.546425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 887/1752] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:15.549626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3594-5cc1-4e84-8664-3ac5a1f7de59 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.550121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3594-5cc1-4e84-8664-3ac5a1f7de59 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.551281 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3594-5cc1-4e84-8664-3ac5a1f7de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:15.588105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-345d3594-5cc1-4e84-8664-3ac5a1f7de59 None None] MFA Rules not processed for user `87489e19ebd44e8eb8f1fc100c911da7`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:15.589924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-345d3594-5cc1-4e84-8664-3ac5a1f7de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:15.662352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779fbff-cbe9-4f71-b210-d9414219b9fa admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:15.680686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1de860-a6dc-4812-9999-207ffe82df23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:15.681365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1de860-a6dc-4812-9999-207ffe82df23 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.681697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1de860-a6dc-4812-9999-207ffe82df23 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.682130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1de860-a6dc-4812-9999-207ffe82df23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:15.711193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 888/1753] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:15.711193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3594-5cc1-4e84-8664-3ac5a1f7de59 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:15.732247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3594-5cc1-4e84-8664-3ac5a1f7de59 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:15.758308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c59a-9c3c-4e8c-8e7b-42fd98f04dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:15.759410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c59a-9c3c-4e8c-8e7b-42fd98f04dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.759687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c59a-9c3c-4e8c-8e7b-42fd98f04dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.759957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c59a-9c3c-4e8c-8e7b-42fd98f04dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:15.762841 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902c59a-9c3c-4e8c-8e7b-42fd98f04dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:15.774804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902c59a-9c3c-4e8c-8e7b-42fd98f04dc3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:15.808958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1de860-a6dc-4812-9999-207ffe82df23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:15.812792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 889/1754] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:15.813685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1de860-a6dc-4812-9999-207ffe82df23 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:15.813869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c59a-9c3c-4e8c-8e7b-42fd98f04dc3 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:15.838323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 866/1755] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:15.839974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1de860-a6dc-4812-9999-207ffe82df23 service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:15.892892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c59a-9c3c-4e8c-8e7b-42fd98f04dc3 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:15.927877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f42f9f-0f31-4559-903c-f15012ceec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:15.928808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f42f9f-0f31-4559-903c-f15012ceec33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:15.929088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f42f9f-0f31-4559-903c-f15012ceec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:15.936693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f42f9f-0f31-4559-903c-f15012ceec33 admin admin] PATH_INFO: `/v3/projects/f7e616ca29b84ea3ab985df63fa6b7ef/users/9ac38219110348348c38871606ad1f60/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:16.019908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f42f9f-0f31-4559-903c-f15012ceec33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e616ca29b84ea3ab985df63fa6b7ef, user_id=9ac38219110348348c38871606ad1f60, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:16.035107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1de860-a6dc-4812-9999-207ffe82df23 service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:16.036307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f42f9f-0f31-4559-903c-f15012ceec33 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:16.050235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be503fde-624c-45ee-9490-e471ec358a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:16.052129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be503fde-624c-45ee-9490-e471ec358a24 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:16.052717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be503fde-624c-45ee-9490-e471ec358a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:16.053827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be503fde-624c-45ee-9490-e471ec358a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:16.085243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 890/1756] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:15 2022] PUT /identity/v3/projects/f7e616ca29b84ea3ab985df63fa6b7ef/users/9ac38219110348348c38871606ad1f60/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:16.101093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f42f9f-0f31-4559-903c-f15012ceec33 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:16.125165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be503fde-624c-45ee-9490-e471ec358a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:16.149850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be503fde-624c-45ee-9490-e471ec358a24 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:16.197120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 867/1757] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:16.200005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29e5f-59ea-48f7-9cc3-8170d86f6a7d None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:16.200283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29e5f-59ea-48f7-9cc3-8170d86f6a7d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:16.200559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29e5f-59ea-48f7-9cc3-8170d86f6a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:16.322610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-35e29e5f-59ea-48f7-9cc3-8170d86f6a7d None None] MFA Rules not processed for user `9ac38219110348348c38871606ad1f60`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:16.323860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-35e29e5f-59ea-48f7-9cc3-8170d86f6a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:16.346295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f42f9f-0f31-4559-903c-f15012ceec33 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:16.362314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad53fc-3238-4641-897e-884074a02a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:16.366079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad53fc-3238-4641-897e-884074a02a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:16.366393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad53fc-3238-4641-897e-884074a02a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:16.372753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad53fc-3238-4641-897e-884074a02a45 admin admin] PATH_INFO: `/v3/projects/d0a01206e6234c0288e1b49bdd74561c/users/ab1f8a56c32044e794971cd63bc4e087/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:16.404846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad53fc-3238-4641-897e-884074a02a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a01206e6234c0288e1b49bdd74561c, user_id=ab1f8a56c32044e794971cd63bc4e087, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:16.410550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad53fc-3238-4641-897e-884074a02a45 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:16.435263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 891/1758] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:16 2022] PUT /identity/v3/projects/d0a01206e6234c0288e1b49bdd74561c/users/ab1f8a56c32044e794971cd63bc4e087/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:16.435904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad53fc-3238-4641-897e-884074a02a45 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:16.504710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 868/1759] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:16.505998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29e5f-59ea-48f7-9cc3-8170d86f6a7d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:16.532838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29e5f-59ea-48f7-9cc3-8170d86f6a7d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:16.615406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad53fc-3238-4641-897e-884074a02a45 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:16.626766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e398a-b740-48ac-ae99-6c88fe0a7546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:16.626766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e398a-b740-48ac-ae99-6c88fe0a7546 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:16.626766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e398a-b740-48ac-ae99-6c88fe0a7546 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:16.632345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e398a-b740-48ac-ae99-6c88fe0a7546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:16.703563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b178a6e-9a96-4d7b-93d0-c757a649168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:16.714273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b178a6e-9a96-4d7b-93d0-c757a649168f admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:16.714760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b178a6e-9a96-4d7b-93d0-c757a649168f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:16.715138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b178a6e-9a96-4d7b-93d0-c757a649168f admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:16.716058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b178a6e-9a96-4d7b-93d0-c757a649168f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:16.719652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b178a6e-9a96-4d7b-93d0-c757a649168f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:16.752017 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 869/1760] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:16.753144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b178a6e-9a96-4d7b-93d0-c757a649168f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:16.779307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b178a6e-9a96-4d7b-93d0-c757a649168f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:16.814056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c569c-84be-4184-8806-83c3287219b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:16.814876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c569c-84be-4184-8806-83c3287219b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:16.815356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c569c-84be-4184-8806-83c3287219b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:16.815965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c569c-84be-4184-8806-83c3287219b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:16.816880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c569c-84be-4184-8806-83c3287219b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:16.820558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c569c-84be-4184-8806-83c3287219b2 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:16.824597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e398a-b740-48ac-ae99-6c88fe0a7546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:16.827613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e398a-b740-48ac-ae99-6c88fe0a7546 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:16.855936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 892/1761] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:16.872040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e398a-b740-48ac-ae99-6c88fe0a7546 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:16.892112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 870/1762] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:16 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:16.897963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c569c-84be-4184-8806-83c3287219b2 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:16.918652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e398a-b740-48ac-ae99-6c88fe0a7546 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:17.054661 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c569c-84be-4184-8806-83c3287219b2 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:17.063513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e153d7-6b8a-4602-a33e-b3c2f99a36a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:17.064735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e153d7-6b8a-4602-a33e-b3c2f99a36a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.065150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e153d7-6b8a-4602-a33e-b3c2f99a36a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.065603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e153d7-6b8a-4602-a33e-b3c2f99a36a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.066520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e153d7-6b8a-4602-a33e-b3c2f99a36a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:17.069821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e153d7-6b8a-4602-a33e-b3c2f99a36a1 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:17.086177 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2d57b-a410-4ba1-984f-b52c77435d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:17.087125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2d57b-a410-4ba1-984f-b52c77435d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.087412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2d57b-a410-4ba1-984f-b52c77435d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.087686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2d57b-a410-4ba1-984f-b52c77435d1e admin admin] PATH_INFO: `/v3/projects/d0a01206e6234c0288e1b49bdd74561c/users/ab1f8a56c32044e794971cd63bc4e087/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.095867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2d57b-a410-4ba1-984f-b52c77435d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a01206e6234c0288e1b49bdd74561c, user_id=ab1f8a56c32044e794971cd63bc4e087, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:17.098978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2d57b-a410-4ba1-984f-b52c77435d1e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:17.123818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 871/1763] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:16 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:17.125671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e153d7-6b8a-4602-a33e-b3c2f99a36a1 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:17.126058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 893/1764] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:16 2022] PUT /identity/v3/projects/d0a01206e6234c0288e1b49bdd74561c/users/ab1f8a56c32044e794971cd63bc4e087/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:17.137409 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff678d-32d9-45a9-86fb-43ef27913d6f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.137707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff678d-32d9-45a9-86fb-43ef27913d6f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.137990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff678d-32d9-45a9-86fb-43ef27913d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.171745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e153d7-6b8a-4602-a33e-b3c2f99a36a1 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:17.201583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-89ff678d-32d9-45a9-86fb-43ef27913d6f None None] MFA Rules not processed for user `ab1f8a56c32044e794971cd63bc4e087`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:17.202870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-89ff678d-32d9-45a9-86fb-43ef27913d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:17.371645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 894/1765] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:17.386554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8666d7-f3a2-4242-8230-f1271b99e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:17.387340 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8666d7-f3a2-4242-8230-f1271b99e9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.388598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff678d-32d9-45a9-86fb-43ef27913d6f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:17.389510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8666d7-f3a2-4242-8230-f1271b99e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.389825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8666d7-f3a2-4242-8230-f1271b99e9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.390582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8666d7-f3a2-4242-8230-f1271b99e9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:17.393037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-89ff678d-32d9-45a9-86fb-43ef27913d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:17.394095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8666d7-f3a2-4242-8230-f1271b99e9bf admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:17.421312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 872/1766] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:17.421312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8666d7-f3a2-4242-8230-f1271b99e9bf admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:17.461780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8666d7-f3a2-4242-8230-f1271b99e9bf admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:17.492071 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7c1e4-a865-4324-94d5-5e83c51974b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:17.493105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7c1e4-a865-4324-94d5-5e83c51974b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.493426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7c1e4-a865-4324-94d5-5e83c51974b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.493697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7c1e4-a865-4324-94d5-5e83c51974b8 admin admin] PATH_INFO: `/v3/projects/5de367c4cb9c4d478b7bcf79c4b1787b/users/5daaf72d8f2148a2b238ef294e9676ac/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.527330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7c1e4-a865-4324-94d5-5e83c51974b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de367c4cb9c4d478b7bcf79c4b1787b, user_id=5daaf72d8f2148a2b238ef294e9676ac, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:17.530372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7c1e4-a865-4324-94d5-5e83c51974b8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:17.554155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 873/1767] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:17 2022] PUT /identity/v3/projects/5de367c4cb9c4d478b7bcf79c4b1787b/users/5daaf72d8f2148a2b238ef294e9676ac/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:17.555863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbba16d-ac40-498a-9a56-20b17c07af6a None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.556332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbba16d-ac40-498a-9a56-20b17c07af6a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.557091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbba16d-ac40-498a-9a56-20b17c07af6a None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.558765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 874/1768] 10.222.0.35 () {54 vars in 912 bytes} [Wed May 4 18:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:57:17.559369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff678d-32d9-45a9-86fb-43ef27913d6f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:17.560223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbba16d-ac40-498a-9a56-20b17c07af6a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:17.636297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86cfa9-39ea-403b-90ef-3e79ec7b7512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:17.637205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86cfa9-39ea-403b-90ef-3e79ec7b7512 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.637535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86cfa9-39ea-403b-90ef-3e79ec7b7512 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.637812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86cfa9-39ea-403b-90ef-3e79ec7b7512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.679058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbba16d-ac40-498a-9a56-20b17c07af6a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:17.690142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842e4bf-cab9-44fb-ace6-8038f8acb8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:17.690892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842e4bf-cab9-44fb-ace6-8038f8acb8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.691180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842e4bf-cab9-44fb-ace6-8038f8acb8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.692609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842e4bf-cab9-44fb-ace6-8038f8acb8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.695170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842e4bf-cab9-44fb-ace6-8038f8acb8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:17.697909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842e4bf-cab9-44fb-ace6-8038f8acb8d9 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:17.725195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 875/1769] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:17.727510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf860-28c7-48d2-8fe7-5715a6aef4b1 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.729128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf860-28c7-48d2-8fe7-5715a6aef4b1 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.729596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf860-28c7-48d2-8fe7-5715a6aef4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.770319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-88bcf860-28c7-48d2-8fe7-5715a6aef4b1 None None] MFA Rules not processed for user `94b338c27d664f51bc9de29c9c6ba40e`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:17.776618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-88bcf860-28c7-48d2-8fe7-5715a6aef4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:17.825889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86cfa9-39ea-403b-90ef-3e79ec7b7512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:17.827545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86cfa9-39ea-403b-90ef-3e79ec7b7512 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:17.861488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 895/1770] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:17.863665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86cfa9-39ea-403b-90ef-3e79ec7b7512 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:17.895334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86cfa9-39ea-403b-90ef-3e79ec7b7512 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:17.900313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e967-478b-4d20-8905-ac484a08d3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:17.901311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e967-478b-4d20-8905-ac484a08d3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:17.901588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e967-478b-4d20-8905-ac484a08d3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:17.901864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489e967-478b-4d20-8905-ac484a08d3c6 admin admin] PATH_INFO: `/v3/projects/5de367c4cb9c4d478b7bcf79c4b1787b/users/5daaf72d8f2148a2b238ef294e9676ac/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:17.905783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489e967-478b-4d20-8905-ac484a08d3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de367c4cb9c4d478b7bcf79c4b1787b, user_id=5daaf72d8f2148a2b238ef294e9676ac, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:17.910091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489e967-478b-4d20-8905-ac484a08d3c6 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:17.928785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 876/1771] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 18:57:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:17.929951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcf860-28c7-48d2-8fe7-5715a6aef4b1 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:17.942020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcf860-28c7-48d2-8fe7-5715a6aef4b1 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:17.952962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 896/1772] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:17 2022] PUT /identity/v3/projects/5de367c4cb9c4d478b7bcf79c4b1787b/users/5daaf72d8f2148a2b238ef294e9676ac/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:17.954045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e967-478b-4d20-8905-ac484a08d3c6 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:17.971184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0489e967-478b-4d20-8905-ac484a08d3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:18.035631 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:18.036412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:18.036517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:18.036774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] PATH_INFO: `/v3/users/4c5924ea4b1941bfaf141f7aa7d35325` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:18.039002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5924ea4b1941bfaf141f7aa7d35325)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:18.040842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:18.069650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489e967-478b-4d20-8905-ac484a08d3c6 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:18.077938 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b39f-b573-4f45-9f8c-e4118988712d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:18.078616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b39f-b573-4f45-9f8c-e4118988712d service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:18.078901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b39f-b573-4f45-9f8c-e4118988712d service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:18.079178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b39f-b573-4f45-9f8c-e4118988712d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:18.087461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27b39f-b573-4f45-9f8c-e4118988712d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:18.099759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27b39f-b573-4f45-9f8c-e4118988712d service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:18.119111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5924ea4b1941bfaf141f7aa7d35325'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:18.122887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 897/1773] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:18.124318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a58b8-f6bb-4656-8e89-4359c51e6d91 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:18.124614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a58b8-f6bb-4656-8e89-4359c51e6d91 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:18.126025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a58b8-f6bb-4656-8e89-4359c51e6d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:18.130369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5924ea4b1941bfaf141f7aa7d35325'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:18.131525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5924ea4b1941bfaf141f7aa7d35325'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:18.132286 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5924ea4b1941bfaf141f7aa7d35325'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:18.148889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-69bf4b19-2244-4efa-93a7-a0a1d10bb494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5924ea4b1941bfaf141f7aa7d35325'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:18.179589 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 877/1774] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:17 2022] DELETE /identity/v3/users/4c5924ea4b1941bfaf141f7aa7d35325 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:18.181817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1bb6f-2be6-4b3e-b4b7-735bf0d0525c None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:18.182278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1bb6f-2be6-4b3e-b4b7-735bf0d0525c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:18.182761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1bb6f-2be6-4b3e-b4b7-735bf0d0525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:18.193786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-1e7a58b8-f6bb-4656-8e89-4359c51e6d91 None None] MFA Rules not processed for user `5daaf72d8f2148a2b238ef294e9676ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:18.199566 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1e7a58b8-f6bb-4656-8e89-4359c51e6d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:18.238522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-15e1bb6f-2be6-4b3e-b4b7-735bf0d0525c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:18.242536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-15e1bb6f-2be6-4b3e-b4b7-735bf0d0525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:18.291114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 898/1775] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:18.303725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a58b8-f6bb-4656-8e89-4359c51e6d91 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:18.305275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1e7a58b8-f6bb-4656-8e89-4359c51e6d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:18.387435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 878/1776] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:18.398607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1bb6f-2be6-4b3e-b4b7-735bf0d0525c None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:18.398927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a58b8-f6bb-4656-8e89-4359c51e6d91 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:18.403676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c339f62-b1f5-489e-a0e8-b977a637d192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:18.404504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c339f62-b1f5-489e-a0e8-b977a637d192 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:18.404960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c339f62-b1f5-489e-a0e8-b977a637d192 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:18.405461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c339f62-b1f5-489e-a0e8-b977a637d192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:18.405573 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-15e1bb6f-2be6-4b3e-b4b7-735bf0d0525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:18.416207 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c339f62-b1f5-489e-a0e8-b977a637d192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:18.418146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c339f62-b1f5-489e-a0e8-b977a637d192 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:18.450418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 899/1777] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:18.531418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1bb6f-2be6-4b3e-b4b7-735bf0d0525c None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:18.538591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ca3fa-34b6-479b-ae12-9c3be3e1a342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:18.542637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca3fa-34b6-479b-ae12-9c3be3e1a342 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:18.543055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca3fa-34b6-479b-ae12-9c3be3e1a342 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:18.544584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca3fa-34b6-479b-ae12-9c3be3e1a342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:18.579544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ca3fa-34b6-479b-ae12-9c3be3e1a342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:18.581648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ca3fa-34b6-479b-ae12-9c3be3e1a342 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:18.610408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 879/1778] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:19.472701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c339f62-b1f5-489e-a0e8-b977a637d192 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:19.474465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5c339f62-b1f5-489e-a0e8-b977a637d192 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:19.530210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c339f62-b1f5-489e-a0e8-b977a637d192 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:19.553840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:19.555011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:19.555479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:19.555992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] PATH_INFO: `/v3/projects/d0d329a7a66046fabe56fdca5eadadc5` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:19.558751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d329a7a66046fabe56fdca5eadadc5)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:19.561108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:19.574641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ca3fa-34b6-479b-ae12-9c3be3e1a342 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:19.576531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-499ca3fa-34b6-479b-ae12-9c3be3e1a342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:19.596179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ca3fa-34b6-479b-ae12-9c3be3e1a342 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:19.603133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:19.604477 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:19.605702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:19.606218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] PATH_INFO: `/v3/users/9ac38219110348348c38871606ad1f60` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:19.611353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac38219110348348c38871606ad1f60)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:19.613840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:19.674884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d329a7a66046fabe56fdca5eadadc5', 'request_id': 'req-37a64186-4e4d-4913-80f0-88451b1a9f8e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.692020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d329a7a66046fabe56fdca5eadadc5', 'request_id': 'req-37a64186-4e4d-4913-80f0-88451b1a9f8e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.708607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d329a7a66046fabe56fdca5eadadc5', 'request_id': 'req-37a64186-4e4d-4913-80f0-88451b1a9f8e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.716663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac38219110348348c38871606ad1f60'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.734243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac38219110348348c38871606ad1f60'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.735960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac38219110348348c38871606ad1f60'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.736384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] The token cache is being invalidate because project d0d329a7a66046fabe56fdca5eadadc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:19.736673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.737635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.738218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac38219110348348c38871606ad1f60'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.746425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 900/1779] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:19 2022] DELETE /identity/v3/projects/d0d329a7a66046fabe56fdca5eadadc5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:19.750384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:19.758619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:19.765842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-39015ba2-d66e-4b1d-988e-a911a7d0994d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac38219110348348c38871606ad1f60'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:19.805133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 880/1780] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:19 2022] DELETE /identity/v3/users/9ac38219110348348c38871606ad1f60 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:19.809437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1409e-17a4-40d6-b456-ec59d1e185a9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:19.809916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1409e-17a4-40d6-b456-ec59d1e185a9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:19.810367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1409e-17a4-40d6-b456-ec59d1e185a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:19.848936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-4ed1409e-17a4-40d6-b456-ec59d1e185a9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:19.850263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4ed1409e-17a4-40d6-b456-ec59d1e185a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:19.882193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64186-4e4d-4913-80f0-88451b1a9f8e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:19.973797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 881/1781] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:19.983475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1409e-17a4-40d6-b456-ec59d1e185a9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:19.986815 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4ed1409e-17a4-40d6-b456-ec59d1e185a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:19.988011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:19.989064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:19.989415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:19.989696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] PATH_INFO: `/v3/users/ab1f8a56c32044e794971cd63bc4e087` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:19.991054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1f8a56c32044e794971cd63bc4e087)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:19.993159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:20.139502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1f8a56c32044e794971cd63bc4e087'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:20.145618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1409e-17a4-40d6-b456-ec59d1e185a9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:20.152744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194315e5-d595-4a34-8e28-2c30bc7b9b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:20.153764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194315e5-d595-4a34-8e28-2c30bc7b9b8b service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:20.154136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194315e5-d595-4a34-8e28-2c30bc7b9b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:20.154392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194315e5-d595-4a34-8e28-2c30bc7b9b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:20.158206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1f8a56c32044e794971cd63bc4e087'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:20.159092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1f8a56c32044e794971cd63bc4e087'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:20.159755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1f8a56c32044e794971cd63bc4e087'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:20.165264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194315e5-d595-4a34-8e28-2c30bc7b9b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:20.167601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194315e5-d595-4a34-8e28-2c30bc7b9b8b service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:20.177884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1f8a56c32044e794971cd63bc4e087'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:20.199827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 882/1782] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:20.202400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649657f8-15e0-4889-ba0b-50127310b9ec None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:20.202915 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649657f8-15e0-4889-ba0b-50127310b9ec None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:20.204394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649657f8-15e0-4889-ba0b-50127310b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:20.214904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 901/1783] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:19 2022] DELETE /identity/v3/users/ab1f8a56c32044e794971cd63bc4e087 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:20.228400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-649657f8-15e0-4889-ba0b-50127310b9ec None None] MFA Rules not processed for user `c6dc233a47d74b4f87ba15d414f1922d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:20.229861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-649657f8-15e0-4889-ba0b-50127310b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:20.368560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 883/1784] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:20.701911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:20.704176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:20.849159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4cb05-15d0-494a-a9f1-7467db0399e3 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:20.866246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:20.867295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:20.867583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:20.867867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] PATH_INFO: `/v3/projects/d0a01206e6234c0288e1b49bdd74561c` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:20.870516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a01206e6234c0288e1b49bdd74561c)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:20.876686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:20.956995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a01206e6234c0288e1b49bdd74561c', 'request_id': 'req-f66b61bc-fb5e-4c54-b970-308e07c560cc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:20.967664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a01206e6234c0288e1b49bdd74561c', 'request_id': 'req-f66b61bc-fb5e-4c54-b970-308e07c560cc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:20.975481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a01206e6234c0288e1b49bdd74561c', 'request_id': 'req-f66b61bc-fb5e-4c54-b970-308e07c560cc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:21.004931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] The token cache is being invalidate because project d0a01206e6234c0288e1b49bdd74561c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:21.005370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:21.005920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f66b61bc-fb5e-4c54-b970-308e07c560cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:21.008363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 902/1785] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:20 2022] DELETE /identity/v3/projects/d0a01206e6234c0288e1b49bdd74561c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:21.013315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc8644-b5fe-4327-b7a8-1838c13ce2c9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.014209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc8644-b5fe-4327-b7a8-1838c13ce2c9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.014865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc8644-b5fe-4327-b7a8-1838c13ce2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.047674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d4fc8644-b5fe-4327-b7a8-1838c13ce2c9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:21.057031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d4fc8644-b5fe-4327-b7a8-1838c13ce2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:21.163820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 884/1786] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:21.167575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47527503-0c53-4920-a9f5-2089edcf32fa None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.167864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47527503-0c53-4920-a9f5-2089edcf32fa None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.168143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47527503-0c53-4920-a9f5-2089edcf32fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.197589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-47527503-0c53-4920-a9f5-2089edcf32fa None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:21.198859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-47527503-0c53-4920-a9f5-2089edcf32fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:21.223887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 903/1787] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:21.227997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc8644-b5fe-4327-b7a8-1838c13ce2c9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:21.243675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc8644-b5fe-4327-b7a8-1838c13ce2c9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:21.256857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6aa45-26f1-4c78-8bc6-a9d8a005e213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:21.257624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6aa45-26f1-4c78-8bc6-a9d8a005e213 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.257910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6aa45-26f1-4c78-8bc6-a9d8a005e213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.258191 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6aa45-26f1-4c78-8bc6-a9d8a005e213 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.259008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6aa45-26f1-4c78-8bc6-a9d8a005e213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:21.259245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6aa45-26f1-4c78-8bc6-a9d8a005e213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:21.261039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6aa45-26f1-4c78-8bc6-a9d8a005e213 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:21.282999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 885/1788] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:21.284132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47527503-0c53-4920-a9f5-2089edcf32fa None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:21.294540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47527503-0c53-4920-a9f5-2089edcf32fa None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:21.309696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930f4f-a843-4983-9c92-98780d89bebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:21.310417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930f4f-a843-4983-9c92-98780d89bebe admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.310689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930f4f-a843-4983-9c92-98780d89bebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.310962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930f4f-a843-4983-9c92-98780d89bebe admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.311756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95930f4f-a843-4983-9c92-98780d89bebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:21.313882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95930f4f-a843-4983-9c92-98780d89bebe admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:21.374870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 904/1789] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:21 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:21.384708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6aa45-26f1-4c78-8bc6-a9d8a005e213 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:21.396304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6aa45-26f1-4c78-8bc6-a9d8a005e213 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:21.526622 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d9dc4-93a7-4969-805b-5b16a3d1914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:21.527361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d9dc4-93a7-4969-805b-5b16a3d1914c admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.527652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d9dc4-93a7-4969-805b-5b16a3d1914c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.527927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d9dc4-93a7-4969-805b-5b16a3d1914c admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.528658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d9dc4-93a7-4969-805b-5b16a3d1914c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:21.530629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d9dc4-93a7-4969-805b-5b16a3d1914c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:21.576217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 886/1790] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:21 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:57:21.579569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930f4f-a843-4983-9c92-98780d89bebe admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:21.592347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930f4f-a843-4983-9c92-98780d89bebe admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:21.610551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c51200-1497-4773-8a06-679337c9d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:21.611295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c51200-1497-4773-8a06-679337c9d8df admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.611630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c51200-1497-4773-8a06-679337c9d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.611915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c51200-1497-4773-8a06-679337c9d8df admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.614855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c51200-1497-4773-8a06-679337c9d8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:21.620560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c51200-1497-4773-8a06-679337c9d8df admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:21.653485 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 905/1791] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:21.654713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d9dc4-93a7-4969-805b-5b16a3d1914c admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:21.669275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d9dc4-93a7-4969-805b-5b16a3d1914c admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:21.682407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e6ecd-2d1a-4fb1-acc5-e3c244d5c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:21.683315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e6ecd-2d1a-4fb1-acc5-e3c244d5c536 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.683718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e6ecd-2d1a-4fb1-acc5-e3c244d5c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.684045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e6ecd-2d1a-4fb1-acc5-e3c244d5c536 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.685444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e6ecd-2d1a-4fb1-acc5-e3c244d5c536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:21.689450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e6ecd-2d1a-4fb1-acc5-e3c244d5c536 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:21.736778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 887/1792] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:21.741370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c51200-1497-4773-8a06-679337c9d8df admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:21.755942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c51200-1497-4773-8a06-679337c9d8df admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:21.769642 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931324e-85b7-47d9-9ef4-ccbdf38f0938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:21.772909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931324e-85b7-47d9-9ef4-ccbdf38f0938 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.773209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931324e-85b7-47d9-9ef4-ccbdf38f0938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.775419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931324e-85b7-47d9-9ef4-ccbdf38f0938 admin admin] PATH_INFO: `/v3/projects/7fce15a38d0f4ca887ef68acf8fca41a/users/4bd7c008f1324045a5fa6f53f3bde2bb/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.818970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931324e-85b7-47d9-9ef4-ccbdf38f0938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fce15a38d0f4ca887ef68acf8fca41a, user_id=4bd7c008f1324045a5fa6f53f3bde2bb, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:21.821762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931324e-85b7-47d9-9ef4-ccbdf38f0938 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:21.858108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 906/1793] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:21 2022] PUT /identity/v3/projects/7fce15a38d0f4ca887ef68acf8fca41a/users/4bd7c008f1324045a5fa6f53f3bde2bb/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:21.868236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16e6ea-3dbe-4f5f-8940-4a87dc2dff81 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.868527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16e6ea-3dbe-4f5f-8940-4a87dc2dff81 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.868802 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16e6ea-3dbe-4f5f-8940-4a87dc2dff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.893270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9fd6f-db9c-41ae-81e6-fc2edb14df8f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:21.894423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9fd6f-db9c-41ae-81e6-fc2edb14df8f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:21.894423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9fd6f-db9c-41ae-81e6-fc2edb14df8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:21.924537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3cc9fd6f-db9c-41ae-81e6-fc2edb14df8f None None] MFA Rules not processed for user `c983699bd73f41fc813c41c498261ece`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:21.925842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3cc9fd6f-db9c-41ae-81e6-fc2edb14df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:21.939486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-da16e6ea-3dbe-4f5f-8940-4a87dc2dff81 None None] MFA Rules not processed for user `4bd7c008f1324045a5fa6f53f3bde2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:21.941375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-da16e6ea-3dbe-4f5f-8940-4a87dc2dff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:22.133821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 907/1794] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:22.189978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 888/1795] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:22.194427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9fd6f-db9c-41ae-81e6-fc2edb14df8f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:22.276755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16e6ea-3dbe-4f5f-8940-4a87dc2dff81 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:22.278397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-da16e6ea-3dbe-4f5f-8940-4a87dc2dff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:22.388338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9fd6f-db9c-41ae-81e6-fc2edb14df8f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:22.403346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a9d6b-de20-4a5f-86d5-810eb3833a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:22.404035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a9d6b-de20-4a5f-86d5-810eb3833a02 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:22.404319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a9d6b-de20-4a5f-86d5-810eb3833a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:22.404610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a9d6b-de20-4a5f-86d5-810eb3833a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:22.405317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a9d6b-de20-4a5f-86d5-810eb3833a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:22.407424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a9d6b-de20-4a5f-86d5-810eb3833a02 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:22.467248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16e6ea-3dbe-4f5f-8940-4a87dc2dff81 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:22.483976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 908/1796] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:22 2022] POST /identity/v3/projects => generated 381 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:22.483976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e059faa-a8d4-4e5a-b27c-48b1de7e14c5 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:22.483976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e059faa-a8d4-4e5a-b27c-48b1de7e14c5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:22.483976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e059faa-a8d4-4e5a-b27c-48b1de7e14c5 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:22.483976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 909/1797] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 18:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:57:22.483976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e059faa-a8d4-4e5a-b27c-48b1de7e14c5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:22.484845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:22.485705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:22.486808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:22.486808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] PATH_INFO: `/v3/projects/f7e616ca29b84ea3ab985df63fa6b7ef` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:22.487701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e616ca29b84ea3ab985df63fa6b7ef)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:22.490283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:22.611660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e616ca29b84ea3ab985df63fa6b7ef', 'request_id': 'req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:22.620911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e616ca29b84ea3ab985df63fa6b7ef', 'request_id': 'req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:22.631535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e616ca29b84ea3ab985df63fa6b7ef', 'request_id': 'req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:22.652896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e059faa-a8d4-4e5a-b27c-48b1de7e14c5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:22.671899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] The token cache is being invalidate because project f7e616ca29b84ea3ab985df63fa6b7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:22.672199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:22.687987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-af0cd6e7-3bc4-43e5-99bc-9eebf38b288f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:22.697662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 889/1798] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:22 2022] DELETE /identity/v3/projects/f7e616ca29b84ea3ab985df63fa6b7ef => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:22.700288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15971-f68d-40eb-8cd9-d43fdb8a66da None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:22.706172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15971-f68d-40eb-8cd9-d43fdb8a66da None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:22.706480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15971-f68d-40eb-8cd9-d43fdb8a66da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:22.762968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-f1c15971-f68d-40eb-8cd9-d43fdb8a66da None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:22.768139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f1c15971-f68d-40eb-8cd9-d43fdb8a66da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:22.789701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c90cf-c348-4340-ac6a-a5b04aaa7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:22.791005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c90cf-c348-4340-ac6a-a5b04aaa7eec admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:22.791456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c90cf-c348-4340-ac6a-a5b04aaa7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:22.791840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c90cf-c348-4340-ac6a-a5b04aaa7eec admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:22.794028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c90cf-c348-4340-ac6a-a5b04aaa7eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:22.808219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c90cf-c348-4340-ac6a-a5b04aaa7eec admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:22.854540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 910/1799] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:22 2022] POST /identity/v3/users => generated 297 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:22.855974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c90cf-c348-4340-ac6a-a5b04aaa7eec admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:22.863739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5b1c90cf-c348-4340-ac6a-a5b04aaa7eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:22.899282 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c90cf-c348-4340-ac6a-a5b04aaa7eec admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:22.910600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 890/1800] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:22.912571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c15971-f68d-40eb-8cd9-d43fdb8a66da None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:22.914493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f1c15971-f68d-40eb-8cd9-d43fdb8a66da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:22.917837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:22.935136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:22.935428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:22.937934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] PATH_INFO: `/v3/users/5daaf72d8f2148a2b238ef294e9676ac` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:22.941499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daaf72d8f2148a2b238ef294e9676ac)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:22.947001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:22.951085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c15971-f68d-40eb-8cd9-d43fdb8a66da None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:22.970792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69471ddf-058f-4269-9d48-d9f8c36d3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:22.971508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69471ddf-058f-4269-9d48-d9f8c36d3ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:22.971795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69471ddf-058f-4269-9d48-d9f8c36d3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:22.972070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69471ddf-058f-4269-9d48-d9f8c36d3ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:22.972835 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69471ddf-058f-4269-9d48-d9f8c36d3ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:22.979375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69471ddf-058f-4269-9d48-d9f8c36d3ae2 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:23.024617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 891/1801] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:23.026232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69471ddf-058f-4269-9d48-d9f8c36d3ae2 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:23.063297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69471ddf-058f-4269-9d48-d9f8c36d3ae2 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:23.073316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f910841-8d6f-4e06-b77a-72d5c7f55f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:23.074246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f910841-8d6f-4e06-b77a-72d5c7f55f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:23.075266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f910841-8d6f-4e06-b77a-72d5c7f55f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:23.075266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f910841-8d6f-4e06-b77a-72d5c7f55f64 admin admin] PATH_INFO: `/v3/projects/f2a721a7cd1741e396a1b533066fc934/users/e9cec0d9c02e4faeb0a86e6489dea50a/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:23.090333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daaf72d8f2148a2b238ef294e9676ac'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:23.097076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f910841-8d6f-4e06-b77a-72d5c7f55f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a721a7cd1741e396a1b533066fc934, user_id=e9cec0d9c02e4faeb0a86e6489dea50a, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:23.101731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f910841-8d6f-4e06-b77a-72d5c7f55f64 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:23.106618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daaf72d8f2148a2b238ef294e9676ac'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:23.113332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daaf72d8f2148a2b238ef294e9676ac'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:23.115525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daaf72d8f2148a2b238ef294e9676ac'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:23.128358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 892/1802] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:23 2022] PUT /identity/v3/projects/f2a721a7cd1741e396a1b533066fc934/users/e9cec0d9c02e4faeb0a86e6489dea50a/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:23.130617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-37ad750e-4d96-4d29-915a-9b13fd3cf810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daaf72d8f2148a2b238ef294e9676ac'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:23.132898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f910841-8d6f-4e06-b77a-72d5c7f55f64 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:23.135121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6f910841-8d6f-4e06-b77a-72d5c7f55f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:23.171329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 911/1803] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:22 2022] DELETE /identity/v3/users/5daaf72d8f2148a2b238ef294e9676ac => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:23.279670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f910841-8d6f-4e06-b77a-72d5c7f55f64 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:23.410106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef101c1b-a2f0-4b36-8edc-dd98f1bdeda1 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:23.410506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef101c1b-a2f0-4b36-8edc-dd98f1bdeda1 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:23.410794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef101c1b-a2f0-4b36-8edc-dd98f1bdeda1 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:23.412535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 912/1804] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 18:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 18:57:23.417167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa3401-f3ca-42f4-ba94-ca760970aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:23.418805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa3401-f3ca-42f4-ba94-ca760970aee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:23.420165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa3401-f3ca-42f4-ba94-ca760970aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:23.420696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa3401-f3ca-42f4-ba94-ca760970aee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:23.422735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa3401-f3ca-42f4-ba94-ca760970aee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:23.428790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa3401-f3ca-42f4-ba94-ca760970aee5 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:23.429324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a057c-624b-4432-a3de-2493fbe20f0a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:23.429764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a057c-624b-4432-a3de-2493fbe20f0a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:23.430181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a057c-624b-4432-a3de-2493fbe20f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:23.464299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 893/1805] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:23.467278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-0f0a057c-624b-4432-a3de-2493fbe20f0a None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:23.468805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0f0a057c-624b-4432-a3de-2493fbe20f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:23.470527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa3401-f3ca-42f4-ba94-ca760970aee5 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:23.500636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa3401-f3ca-42f4-ba94-ca760970aee5 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:23.504299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcc83-4a75-4867-bdab-8bbaf029ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:23.505507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcc83-4a75-4867-bdab-8bbaf029ce17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:23.505853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcc83-4a75-4867-bdab-8bbaf029ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:23.506098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcc83-4a75-4867-bdab-8bbaf029ce17 admin admin] PATH_INFO: `/v3/projects/f2a721a7cd1741e396a1b533066fc934/users/e9cec0d9c02e4faeb0a86e6489dea50a/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:23.510925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dcc83-4a75-4867-bdab-8bbaf029ce17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a721a7cd1741e396a1b533066fc934, user_id=e9cec0d9c02e4faeb0a86e6489dea50a, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:23.513691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dcc83-4a75-4867-bdab-8bbaf029ce17 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:23.543296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 894/1806] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:23 2022] PUT /identity/v3/projects/f2a721a7cd1741e396a1b533066fc934/users/e9cec0d9c02e4faeb0a86e6489dea50a/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:23.552461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47adb3-e404-4e90-8f35-590c24cac80c None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:23.552690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47adb3-e404-4e90-8f35-590c24cac80c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:23.553070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47adb3-e404-4e90-8f35-590c24cac80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:23.610879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 913/1807] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:23.618064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-6f47adb3-e404-4e90-8f35-590c24cac80c None None] MFA Rules not processed for user `e9cec0d9c02e4faeb0a86e6489dea50a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:23.624429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6f47adb3-e404-4e90-8f35-590c24cac80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:23.698921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a057c-624b-4432-a3de-2493fbe20f0a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:23.700341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0f0a057c-624b-4432-a3de-2493fbe20f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:23.714362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a057c-624b-4432-a3de-2493fbe20f0a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:23.741228 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 895/1808] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:23.754720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47adb3-e404-4e90-8f35-590c24cac80c None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:23.756390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6f47adb3-e404-4e90-8f35-590c24cac80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:23.796439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8dbb5-239c-49e1-a916-2f6961186f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:23.797245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8dbb5-239c-49e1-a916-2f6961186f81 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:23.797634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8dbb5-239c-49e1-a916-2f6961186f81 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:23.797999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8dbb5-239c-49e1-a916-2f6961186f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:23.800264 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1de8dbb5-239c-49e1-a916-2f6961186f81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:23.817534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8dbb5-239c-49e1-a916-2f6961186f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:23.824866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8dbb5-239c-49e1-a916-2f6961186f81 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:23.840957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 914/1809] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:23.843256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47adb3-e404-4e90-8f35-590c24cac80c None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:23.849780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38153218-142e-48ce-b219-514091550b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:23.850367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38153218-142e-48ce-b219-514091550b95 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:23.850645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38153218-142e-48ce-b219-514091550b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:23.850969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38153218-142e-48ce-b219-514091550b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:23.864901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38153218-142e-48ce-b219-514091550b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:23.866715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38153218-142e-48ce-b219-514091550b95 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:23.894945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8dbb5-239c-49e1-a916-2f6961186f81 service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:23.897341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 896/1810] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:23.912764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8dbb5-239c-49e1-a916-2f6961186f81 service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:23.921978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233a48-ddac-4008-bada-58088e940f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:23.923202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233a48-ddac-4008-bada-58088e940f84 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:23.923648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233a48-ddac-4008-bada-58088e940f84 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:23.923924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d233a48-ddac-4008-bada-58088e940f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:23.940209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233a48-ddac-4008-bada-58088e940f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:23.943815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d233a48-ddac-4008-bada-58088e940f84 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:23.972117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 915/1811] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:57:24.030927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38153218-142e-48ce-b219-514091550b95 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.042406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38153218-142e-48ce-b219-514091550b95 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.047817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379427a1-0867-4236-8101-a96816a66ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.048097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379427a1-0867-4236-8101-a96816a66ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.048285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379427a1-0867-4236-8101-a96816a66ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.048567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379427a1-0867-4236-8101-a96816a66ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.050551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-379427a1-0867-4236-8101-a96816a66ba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:24.099113 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233a48-ddac-4008-bada-58088e940f84 service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.101002 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3d233a48-ddac-4008-bada-58088e940f84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:24.147630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379427a1-0867-4236-8101-a96816a66ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:24.149048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379427a1-0867-4236-8101-a96816a66ba9 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:24.170744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 897/1812] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:24.198598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d233a48-ddac-4008-bada-58088e940f84 service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.215014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.229837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.230353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.230531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] PATH_INFO: `/v3/projects/5de367c4cb9c4d478b7bcf79c4b1787b` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.234320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de367c4cb9c4d478b7bcf79c4b1787b)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:24.236843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:24.336515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de367c4cb9c4d478b7bcf79c4b1787b', 'request_id': 'req-cc82e536-b0b9-43e1-978a-e556f38263f0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.346618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de367c4cb9c4d478b7bcf79c4b1787b', 'request_id': 'req-cc82e536-b0b9-43e1-978a-e556f38263f0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.356339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de367c4cb9c4d478b7bcf79c4b1787b', 'request_id': 'req-cc82e536-b0b9-43e1-978a-e556f38263f0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.368254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] The token cache is being invalidate because project 5de367c4cb9c4d478b7bcf79c4b1787b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:24.368603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.369423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cc82e536-b0b9-43e1-978a-e556f38263f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.373411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 916/1813] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:24 2022] DELETE /identity/v3/projects/5de367c4cb9c4d478b7bcf79c4b1787b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:24.376532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb3b82-2058-44de-a403-5671461c5d99 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.377374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb3b82-2058-44de-a403-5671461c5d99 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.377865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb3b82-2058-44de-a403-5671461c5d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.397023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-03eb3b82-2058-44de-a403-5671461c5d99 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:24.398568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-03eb3b82-2058-44de-a403-5671461c5d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:24.473144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 898/1814] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:24.481157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd66c66-eb5f-4823-a7ff-eaa0b33c2b49 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.481512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd66c66-eb5f-4823-a7ff-eaa0b33c2b49 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.481797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd66c66-eb5f-4823-a7ff-eaa0b33c2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.502760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-fdd66c66-eb5f-4823-a7ff-eaa0b33c2b49 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:24.504321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fdd66c66-eb5f-4823-a7ff-eaa0b33c2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:24.513798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 917/1815] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:24.517801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb3b82-2058-44de-a403-5671461c5d99 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.526547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd66c66-eb5f-4823-a7ff-eaa0b33c2b49 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.528722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fdd66c66-eb5f-4823-a7ff-eaa0b33c2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:24.535250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb3b82-2058-44de-a403-5671461c5d99 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.541222 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901ff5a-b3c3-43dc-8f80-655937a6e968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.542019 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901ff5a-b3c3-43dc-8f80-655937a6e968 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.542215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd66c66-eb5f-4823-a7ff-eaa0b33c2b49 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.542316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901ff5a-b3c3-43dc-8f80-655937a6e968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.542553 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901ff5a-b3c3-43dc-8f80-655937a6e968 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.543422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901ff5a-b3c3-43dc-8f80-655937a6e968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:24.543751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901ff5a-b3c3-43dc-8f80-655937a6e968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:24.545791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901ff5a-b3c3-43dc-8f80-655937a6e968 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:24.551725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.552811 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.553163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.553545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] PATH_INFO: `/v3/users/4bd7c008f1324045a5fa6f53f3bde2bb` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.554911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd7c008f1324045a5fa6f53f3bde2bb)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:24.556992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:24.564428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 899/1816] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:57:24.568837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901ff5a-b3c3-43dc-8f80-655937a6e968 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.586938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901ff5a-b3c3-43dc-8f80-655937a6e968 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.591056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a7368-b644-4d47-970f-14e7adaf79b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.591798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a7368-b644-4d47-970f-14e7adaf79b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.592274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a7368-b644-4d47-970f-14e7adaf79b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.592543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a7368-b644-4d47-970f-14e7adaf79b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.593243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a7368-b644-4d47-970f-14e7adaf79b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:24.595208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a7368-b644-4d47-970f-14e7adaf79b0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:24.618874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd7c008f1324045a5fa6f53f3bde2bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.628736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd7c008f1324045a5fa6f53f3bde2bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.629692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd7c008f1324045a5fa6f53f3bde2bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.630401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd7c008f1324045a5fa6f53f3bde2bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.647220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dcabf174-632f-407f-8cb8-0e1dbda6211b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd7c008f1324045a5fa6f53f3bde2bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:24.678797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 918/1817] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:24 2022] DELETE /identity/v3/users/4bd7c008f1324045a5fa6f53f3bde2bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:24.689108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad08a7-522b-47cf-905c-6e08ba0da743 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.689443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad08a7-522b-47cf-905c-6e08ba0da743 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.689785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad08a7-522b-47cf-905c-6e08ba0da743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.735507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5fad08a7-522b-47cf-905c-6e08ba0da743 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:24.736783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5fad08a7-522b-47cf-905c-6e08ba0da743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:24.795986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 900/1818] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:24 2022] POST /identity/v3/projects => generated 365 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:24.800626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a7368-b644-4d47-970f-14e7adaf79b0 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.807498 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-be5a7368-b644-4d47-970f-14e7adaf79b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:24.851571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 919/1819] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:24.861743 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad08a7-522b-47cf-905c-6e08ba0da743 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.863058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5fad08a7-522b-47cf-905c-6e08ba0da743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:24.884979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a7368-b644-4d47-970f-14e7adaf79b0 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.889694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160e8e2-6662-4bb4-8083-ee977c81210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.890495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e8e2-6662-4bb4-8083-ee977c81210a admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.890792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e8e2-6662-4bb4-8083-ee977c81210a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.891054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160e8e2-6662-4bb4-8083-ee977c81210a admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.891899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160e8e2-6662-4bb4-8083-ee977c81210a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:24.894009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160e8e2-6662-4bb4-8083-ee977c81210a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:24.914304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 901/1820] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:24 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:24.918368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160e8e2-6662-4bb4-8083-ee977c81210a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.920859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad08a7-522b-47cf-905c-6e08ba0da743 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.927394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160e8e2-6662-4bb4-8083-ee977c81210a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.932169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d47ef-10ad-40d8-964e-c5caa0c53f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.932828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d47ef-10ad-40d8-964e-c5caa0c53f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.933110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d47ef-10ad-40d8-964e-c5caa0c53f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.933415 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d47ef-10ad-40d8-964e-c5caa0c53f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.934160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d47ef-10ad-40d8-964e-c5caa0c53f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:24.935758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d47ef-10ad-40d8-964e-c5caa0c53f63 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:24.946083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 902/1821] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:24.950097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d47ef-10ad-40d8-964e-c5caa0c53f63 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.959436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d47ef-10ad-40d8-964e-c5caa0c53f63 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.963986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a28cd-eeb0-43b4-9261-109a6eda5625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.964747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a28cd-eeb0-43b4-9261-109a6eda5625 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.964935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a28cd-eeb0-43b4-9261-109a6eda5625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.965202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a28cd-eeb0-43b4-9261-109a6eda5625 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.965958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a28cd-eeb0-43b4-9261-109a6eda5625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:24.967606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a28cd-eeb0-43b4-9261-109a6eda5625 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:24.968232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bfc36-0d7c-4af2-998d-570fc9bad92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.968914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bfc36-0d7c-4af2-998d-570fc9bad92a service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.969200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bfc36-0d7c-4af2-998d-570fc9bad92a service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.969511 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bfc36-0d7c-4af2-998d-570fc9bad92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:24.977449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 903/1822] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:24.978874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bfc36-0d7c-4af2-998d-570fc9bad92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:24.980383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bfc36-0d7c-4af2-998d-570fc9bad92a service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:24.981504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a28cd-eeb0-43b4-9261-109a6eda5625 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:24.990284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 920/1823] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:57:24.990668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a28cd-eeb0-43b4-9261-109a6eda5625 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:24.995508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0801d-9918-4ff6-81f3-9b47b912a5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:24.996395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0801d-9918-4ff6-81f3-9b47b912a5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:24.996784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0801d-9918-4ff6-81f3-9b47b912a5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:24.996946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0801d-9918-4ff6-81f3-9b47b912a5ed admin admin] PATH_INFO: `/v3/projects/5ed0bfe300ff46a0ab3a91822b362420/users/02197d5b80f642b5be98d313aff29dcc/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.011710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0801d-9918-4ff6-81f3-9b47b912a5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed0bfe300ff46a0ab3a91822b362420, user_id=02197d5b80f642b5be98d313aff29dcc, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:25.014502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0801d-9918-4ff6-81f3-9b47b912a5ed admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:25.028511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 904/1824] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:24 2022] PUT /identity/v3/projects/5ed0bfe300ff46a0ab3a91822b362420/users/02197d5b80f642b5be98d313aff29dcc/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:25.041200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb93e25-ccc1-4786-bc0d-4085b75be7f6 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.041531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb93e25-ccc1-4786-bc0d-4085b75be7f6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.041813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb93e25-ccc1-4786-bc0d-4085b75be7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.069417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9bb93e25-ccc1-4786-bc0d-4085b75be7f6 None None] MFA Rules not processed for user `02197d5b80f642b5be98d313aff29dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:25.070634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9bb93e25-ccc1-4786-bc0d-4085b75be7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:25.139704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 921/1825] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:25.144501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0801d-9918-4ff6-81f3-9b47b912a5ed admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:25.213402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0801d-9918-4ff6-81f3-9b47b912a5ed admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:25.219965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0bc7-3458-4d90-8523-7a7fcd266d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:25.220863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0bc7-3458-4d90-8523-7a7fcd266d60 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.221156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0bc7-3458-4d90-8523-7a7fcd266d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.221474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0bc7-3458-4d90-8523-7a7fcd266d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.222176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe0bc7-3458-4d90-8523-7a7fcd266d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:25.224552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe0bc7-3458-4d90-8523-7a7fcd266d60 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:25.254009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 905/1826] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:25 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:25.257965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb93e25-ccc1-4786-bc0d-4085b75be7f6 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:25.258223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0bc7-3458-4d90-8523-7a7fcd266d60 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:25.259361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9bb93e25-ccc1-4786-bc0d-4085b75be7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:25.286033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb93e25-ccc1-4786-bc0d-4085b75be7f6 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:25.319238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0bc7-3458-4d90-8523-7a7fcd266d60 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:25.323857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb86a8-b73c-4f86-b6ca-a2cd9117e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:25.324542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb86a8-b73c-4f86-b6ca-a2cd9117e96e admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.324832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb86a8-b73c-4f86-b6ca-a2cd9117e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.325102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb86a8-b73c-4f86-b6ca-a2cd9117e96e admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.325831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb86a8-b73c-4f86-b6ca-a2cd9117e96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:25.328740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb86a8-b73c-4f86-b6ca-a2cd9117e96e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:25.348012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:25.349223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.349615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.349899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] PATH_INFO: `/v3/projects/7fce15a38d0f4ca887ef68acf8fca41a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.352040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fce15a38d0f4ca887ef68acf8fca41a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:25.354352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:25.363292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 906/1827] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:25 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:25.367626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb86a8-b73c-4f86-b6ca-a2cd9117e96e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:25.391473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb86a8-b73c-4f86-b6ca-a2cd9117e96e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:25.405779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76294794-7040-4d90-bfa2-55d8ee968cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:25.406558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76294794-7040-4d90-bfa2-55d8ee968cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.406860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76294794-7040-4d90-bfa2-55d8ee968cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.407125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76294794-7040-4d90-bfa2-55d8ee968cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.407895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76294794-7040-4d90-bfa2-55d8ee968cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:25.413666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76294794-7040-4d90-bfa2-55d8ee968cc2 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:25.424478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 907/1828] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:25.428596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76294794-7040-4d90-bfa2-55d8ee968cc2 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:25.439246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76294794-7040-4d90-bfa2-55d8ee968cc2 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:25.449309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fce15a38d0f4ca887ef68acf8fca41a', 'request_id': 'req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:25.465905 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fce15a38d0f4ca887ef68acf8fca41a', 'request_id': 'req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:25.476262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fce15a38d0f4ca887ef68acf8fca41a', 'request_id': 'req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:25.501352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] The token cache is being invalidate because project 7fce15a38d0f4ca887ef68acf8fca41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:25.501732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:25.503291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:25.508092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 922/1829] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:25 2022] DELETE /identity/v3/projects/7fce15a38d0f4ca887ef68acf8fca41a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:25.509313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:25.511371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:25.589742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f0ea-055b-4282-9b74-5a24d7431133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:25.592408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f0ea-055b-4282-9b74-5a24d7431133 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.592696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f0ea-055b-4282-9b74-5a24d7431133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.595134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f0ea-055b-4282-9b74-5a24d7431133 admin admin] PATH_INFO: `/v3/projects/d10f09ebb4cc4b3ab84fa781bf5a119d/users/c4444323708c45e4bd23ebbb5db20836/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.645566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19f0ea-055b-4282-9b74-5a24d7431133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10f09ebb4cc4b3ab84fa781bf5a119d, user_id=c4444323708c45e4bd23ebbb5db20836, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:25.648302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19f0ea-055b-4282-9b74-5a24d7431133 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:25.712338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 908/1830] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:25 2022] PUT /identity/v3/projects/d10f09ebb4cc4b3ab84fa781bf5a119d/users/c4444323708c45e4bd23ebbb5db20836/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:25.715704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f0ea-055b-4282-9b74-5a24d7431133 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:25.720882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702871f-d6f6-4091-a30f-8e8a7e42cc6c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:25.721140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-de19f0ea-055b-4282-9b74-5a24d7431133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:25.818850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f0ea-055b-4282-9b74-5a24d7431133 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:25.824989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f8f7-c66a-467a-89bb-1886ccd5acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:25.825834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f8f7-c66a-467a-89bb-1886ccd5acd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.827302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f8f7-c66a-467a-89bb-1886ccd5acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.827683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f8f7-c66a-467a-89bb-1886ccd5acd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.829827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1f8f7-c66a-467a-89bb-1886ccd5acd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:25.833020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1f8f7-c66a-467a-89bb-1886ccd5acd4 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:25.864490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 909/1831] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:25.870986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:25.874168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.875336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.877816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] PATH_INFO: `/v3/users/e9cec0d9c02e4faeb0a86e6489dea50a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.878178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f8f7-c66a-467a-89bb-1886ccd5acd4 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:25.883988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cec0d9c02e4faeb0a86e6489dea50a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:25.896808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:25.901985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f8f7-c66a-467a-89bb-1886ccd5acd4 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:25.909315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220175b-c5f6-4721-951b-8d6fc47b6767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:25.911563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220175b-c5f6-4721-951b-8d6fc47b6767 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.911915 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220175b-c5f6-4721-951b-8d6fc47b6767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.912515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220175b-c5f6-4721-951b-8d6fc47b6767 admin admin] PATH_INFO: `/v3/projects/d10f09ebb4cc4b3ab84fa781bf5a119d/users/c4444323708c45e4bd23ebbb5db20836/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.915931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220175b-c5f6-4721-951b-8d6fc47b6767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10f09ebb4cc4b3ab84fa781bf5a119d, user_id=c4444323708c45e4bd23ebbb5db20836, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:25.921592 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220175b-c5f6-4721-951b-8d6fc47b6767 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:25.937482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 910/1832] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:25 2022] PUT /identity/v3/projects/d10f09ebb4cc4b3ab84fa781bf5a119d/users/c4444323708c45e4bd23ebbb5db20836/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:25.949783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca89376-797a-453d-91f3-69f02508def1 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:25.950767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca89376-797a-453d-91f3-69f02508def1 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:25.950767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca89376-797a-453d-91f3-69f02508def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:25.990009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7ca89376-797a-453d-91f3-69f02508def1 None None] MFA Rules not processed for user `c4444323708c45e4bd23ebbb5db20836`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:25.991388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7ca89376-797a-453d-91f3-69f02508def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:26.004671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cec0d9c02e4faeb0a86e6489dea50a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:26.018166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cec0d9c02e4faeb0a86e6489dea50a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:26.019286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cec0d9c02e4faeb0a86e6489dea50a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:26.020285 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cec0d9c02e4faeb0a86e6489dea50a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:26.032908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cec0d9c02e4faeb0a86e6489dea50a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:26.065918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 923/1833] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:25 2022] DELETE /identity/v3/users/e9cec0d9c02e4faeb0a86e6489dea50a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:26.134839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 911/1834] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:25 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:26.146686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:26.148082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:26.228691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8830a-01bd-4abb-8d1e-fcbb3707f1fc admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:26.232635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8395d-fce0-4d2d-a2f0-8a273256a0a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:26.233311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8395d-fce0-4d2d-a2f0-8a273256a0a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:26.233596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8395d-fce0-4d2d-a2f0-8a273256a0a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:26.233999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8395d-fce0-4d2d-a2f0-8a273256a0a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:26.395865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8395d-fce0-4d2d-a2f0-8a273256a0a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:26.398128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8395d-fce0-4d2d-a2f0-8a273256a0a5 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:26.419305 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 924/1835] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:26 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:26.534612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca89376-797a-453d-91f3-69f02508def1 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:26.628760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca89376-797a-453d-91f3-69f02508def1 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:26.633602 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b59a9e-2aaf-45ae-a7b9-cca84166472a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:26.634505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b59a9e-2aaf-45ae-a7b9-cca84166472a service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:26.635114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b59a9e-2aaf-45ae-a7b9-cca84166472a service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:26.635925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b59a9e-2aaf-45ae-a7b9-cca84166472a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:26.638346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-06b59a9e-2aaf-45ae-a7b9-cca84166472a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:26.803738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b59a9e-2aaf-45ae-a7b9-cca84166472a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:26.805835 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b59a9e-2aaf-45ae-a7b9-cca84166472a service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:26.818877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 912/1836] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:27.009460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8395d-fce0-4d2d-a2f0-8a273256a0a5 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:27.011646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ddf8395d-fce0-4d2d-a2f0-8a273256a0a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:27.153307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8395d-fce0-4d2d-a2f0-8a273256a0a5 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:27.158694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:27.159573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.159856 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.160133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] PATH_INFO: `/v3/projects/f2a721a7cd1741e396a1b533066fc934` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.162465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a721a7cd1741e396a1b533066fc934)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:27.164397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:27.229758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a721a7cd1741e396a1b533066fc934', 'request_id': 'req-4ea6cf99-b406-458e-aa8c-d60f4504cc96'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:27.238669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a721a7cd1741e396a1b533066fc934', 'request_id': 'req-4ea6cf99-b406-458e-aa8c-d60f4504cc96'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:27.245471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a721a7cd1741e396a1b533066fc934', 'request_id': 'req-4ea6cf99-b406-458e-aa8c-d60f4504cc96'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:27.256919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] The token cache is being invalidate because project f2a721a7cd1741e396a1b533066fc934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:27.257318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:27.258004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4ea6cf99-b406-458e-aa8c-d60f4504cc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:27.261336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 925/1837] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:27 2022] DELETE /identity/v3/projects/f2a721a7cd1741e396a1b533066fc934 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:27.265392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db410f-f841-4d86-9fc4-e5b457877bfb None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.265685 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db410f-f841-4d86-9fc4-e5b457877bfb None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.265963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db410f-f841-4d86-9fc4-e5b457877bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.284103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c2db410f-f841-4d86-9fc4-e5b457877bfb None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:27.285410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c2db410f-f841-4d86-9fc4-e5b457877bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:27.360769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 913/1838] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:27.368663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709573-198d-4a89-b15e-827425d5df9b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.369199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709573-198d-4a89-b15e-827425d5df9b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.369631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709573-198d-4a89-b15e-827425d5df9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.401152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-8c709573-198d-4a89-b15e-827425d5df9b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:27.402690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-8c709573-198d-4a89-b15e-827425d5df9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:27.414775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 926/1839] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:27.419740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db410f-f841-4d86-9fc4-e5b457877bfb None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:27.434998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db410f-f841-4d86-9fc4-e5b457877bfb None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:27.451253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cd34b-8d6b-4502-8936-c85d24a8e80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:27.452060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cd34b-8d6b-4502-8936-c85d24a8e80f admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.452356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cd34b-8d6b-4502-8936-c85d24a8e80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.452808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cd34b-8d6b-4502-8936-c85d24a8e80f admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.454596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cd34b-8d6b-4502-8936-c85d24a8e80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:27.454948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cd34b-8d6b-4502-8936-c85d24a8e80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:27.456790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cd34b-8d6b-4502-8936-c85d24a8e80f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:27.492335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 914/1840] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:27.494010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c709573-198d-4a89-b15e-827425d5df9b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:27.507607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c709573-198d-4a89-b15e-827425d5df9b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:27.513226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a99fff-fd32-42a7-82a6-05ee683dea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:27.514843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a99fff-fd32-42a7-82a6-05ee683dea8d admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.515137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a99fff-fd32-42a7-82a6-05ee683dea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.515462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a99fff-fd32-42a7-82a6-05ee683dea8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.516192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a99fff-fd32-42a7-82a6-05ee683dea8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:27.519113 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a99fff-fd32-42a7-82a6-05ee683dea8d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:27.553133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 927/1841] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:27 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:27.558098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cd34b-8d6b-4502-8936-c85d24a8e80f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:27.569337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cd34b-8d6b-4502-8936-c85d24a8e80f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:27.630318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a3e0e-d6f9-4d12-bf92-0b94942f57f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:27.631007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a3e0e-d6f9-4d12-bf92-0b94942f57f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.631287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a3e0e-d6f9-4d12-bf92-0b94942f57f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.631556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a3e0e-d6f9-4d12-bf92-0b94942f57f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.632280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a3e0e-d6f9-4d12-bf92-0b94942f57f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:27.634215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a3e0e-d6f9-4d12-bf92-0b94942f57f5 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:27.657392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 915/1842] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:27 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:27.659317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a99fff-fd32-42a7-82a6-05ee683dea8d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:27.670119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a99fff-fd32-42a7-82a6-05ee683dea8d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:27.674869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661596fe-3fbb-421c-9676-96b33a60b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:27.675662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661596fe-3fbb-421c-9676-96b33a60b63f admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.676016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661596fe-3fbb-421c-9676-96b33a60b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.676363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661596fe-3fbb-421c-9676-96b33a60b63f admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.677202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661596fe-3fbb-421c-9676-96b33a60b63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:27.679026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661596fe-3fbb-421c-9676-96b33a60b63f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:27.690458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 928/1843] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:27.695052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a3e0e-d6f9-4d12-bf92-0b94942f57f5 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:27.706946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a3e0e-d6f9-4d12-bf92-0b94942f57f5 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:27.712535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f8c4b-a3bf-4924-a019-a26a29826c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:27.713308 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8c4b-a3bf-4924-a019-a26a29826c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.713614 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8c4b-a3bf-4924-a019-a26a29826c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.713891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8c4b-a3bf-4924-a019-a26a29826c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.714636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8c4b-a3bf-4924-a019-a26a29826c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:27.716289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8c4b-a3bf-4924-a019-a26a29826c10 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:27.727154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 916/1844] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:27.731818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661596fe-3fbb-421c-9676-96b33a60b63f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:27.742158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661596fe-3fbb-421c-9676-96b33a60b63f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:27.750900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baf461-2215-424b-ab2d-6672b2483339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:27.752357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baf461-2215-424b-ab2d-6672b2483339 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.752774 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baf461-2215-424b-ab2d-6672b2483339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.753090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baf461-2215-424b-ab2d-6672b2483339 admin admin] PATH_INFO: `/v3/projects/6246e8e0efa54df99200eb2281778272/users/2a1afcef95de46cbb4d9456b3224ef36/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.769913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baf461-2215-424b-ab2d-6672b2483339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6246e8e0efa54df99200eb2281778272, user_id=2a1afcef95de46cbb4d9456b3224ef36, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:27.772588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baf461-2215-424b-ab2d-6672b2483339 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:27.787319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 929/1845] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:27 2022] PUT /identity/v3/projects/6246e8e0efa54df99200eb2281778272/users/2a1afcef95de46cbb4d9456b3224ef36/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:27.792652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30699f-4ae9-4044-bc96-f0d3c0421804 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:27.793064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30699f-4ae9-4044-bc96-f0d3c0421804 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:27.793384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30699f-4ae9-4044-bc96-f0d3c0421804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:27.816127 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-bd30699f-4ae9-4044-bc96-f0d3c0421804 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:27.817417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-bd30699f-4ae9-4044-bc96-f0d3c0421804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:27.951691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 917/1846] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:27.975797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baf461-2215-424b-ab2d-6672b2483339 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:27.978175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-92baf461-2215-424b-ab2d-6672b2483339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:28.106105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baf461-2215-424b-ab2d-6672b2483339 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:28.110131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782953e-43e3-44c8-93d9-1e5f3b5ac6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:28.110950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782953e-43e3-44c8-93d9-1e5f3b5ac6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:28.111479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782953e-43e3-44c8-93d9-1e5f3b5ac6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:28.111814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782953e-43e3-44c8-93d9-1e5f3b5ac6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:28.126606 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782953e-43e3-44c8-93d9-1e5f3b5ac6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:28.128651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782953e-43e3-44c8-93d9-1e5f3b5ac6f0 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:28.149221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 930/1847] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:29.804951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30699f-4ae9-4044-bc96-f0d3c0421804 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:29.806817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-bd30699f-4ae9-4044-bc96-f0d3c0421804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:29.821790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30699f-4ae9-4044-bc96-f0d3c0421804 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:29.834574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:29.835671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:29.836213 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:29.836580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] PATH_INFO: `/v3/users/7355f42b7e9d40cfb26854562f85718c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:29.838152 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7355f42b7e9d40cfb26854562f85718c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:29.840511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:29.936287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7355f42b7e9d40cfb26854562f85718c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:29.945459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7355f42b7e9d40cfb26854562f85718c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:29.946394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7355f42b7e9d40cfb26854562f85718c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:29.946991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7355f42b7e9d40cfb26854562f85718c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:29.962240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-596509cf-a3e7-4c4a-b2db-f33cf58a9661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7355f42b7e9d40cfb26854562f85718c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:29.979670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c1077-4f02-4ccd-b8fd-bbac8c763da6 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:29.980181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c1077-4f02-4ccd-b8fd-bbac8c763da6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:29.980366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c1077-4f02-4ccd-b8fd-bbac8c763da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:30.001206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 918/1848] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:29 2022] DELETE /identity/v3/users/7355f42b7e9d40cfb26854562f85718c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:30.005581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00964ba-71f4-452c-b08e-1ee4e6dd764d None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:30.005842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00964ba-71f4-452c-b08e-1ee4e6dd764d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:30.006123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00964ba-71f4-452c-b08e-1ee4e6dd764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:30.045156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a00964ba-71f4-452c-b08e-1ee4e6dd764d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:30.049401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a00964ba-71f4-452c-b08e-1ee4e6dd764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:30.077616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-585c1077-4f02-4ccd-b8fd-bbac8c763da6 None None] MFA Rules not processed for user `2a1afcef95de46cbb4d9456b3224ef36`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:30.085484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-585c1077-4f02-4ccd-b8fd-bbac8c763da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:30.201367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 919/1849] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:30.212456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00964ba-71f4-452c-b08e-1ee4e6dd764d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:30.213748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a00964ba-71f4-452c-b08e-1ee4e6dd764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:30.217160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 931/1850] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:30.221546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c1077-4f02-4ccd-b8fd-bbac8c763da6 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:30.223914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-585c1077-4f02-4ccd-b8fd-bbac8c763da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:30.246253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c1077-4f02-4ccd-b8fd-bbac8c763da6 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:30.276309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012a02-65c0-4ecc-9fe6-c5adcc7146c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:30.281841 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012a02-65c0-4ecc-9fe6-c5adcc7146c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:30.282548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012a02-65c0-4ecc-9fe6-c5adcc7146c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:30.285112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012a02-65c0-4ecc-9fe6-c5adcc7146c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:30.288796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79012a02-65c0-4ecc-9fe6-c5adcc7146c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:30.301443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79012a02-65c0-4ecc-9fe6-c5adcc7146c7 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:30.397227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 932/1851] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:30 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:57:30.401661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012a02-65c0-4ecc-9fe6-c5adcc7146c7 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:30.404808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00964ba-71f4-452c-b08e-1ee4e6dd764d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:30.533106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d41c4-35be-4624-96a3-b62e34552eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:30.534576 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d41c4-35be-4624-96a3-b62e34552eea service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:30.534862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d41c4-35be-4624-96a3-b62e34552eea service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:30.535137 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d41c4-35be-4624-96a3-b62e34552eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:30.540993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012a02-65c0-4ecc-9fe6-c5adcc7146c7 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:30.554106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35615d-094b-40d9-9970-db12787f1327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:30.555081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35615d-094b-40d9-9970-db12787f1327 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:30.555510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35615d-094b-40d9-9970-db12787f1327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:30.555679 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d41c4-35be-4624-96a3-b62e34552eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:30.555878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35615d-094b-40d9-9970-db12787f1327 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:30.558164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35615d-094b-40d9-9970-db12787f1327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:30.564110 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35615d-094b-40d9-9970-db12787f1327 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:30.564337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d41c4-35be-4624-96a3-b62e34552eea service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:30.581787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 920/1852] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:30.612885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 933/1853] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:30 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:30.617033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d41c4-35be-4624-96a3-b62e34552eea service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:30.636609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d41c4-35be-4624-96a3-b62e34552eea service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:30.653326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e0d3-d0ee-4bb0-92f5-4ad9d0d0e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:30.654621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e0d3-d0ee-4bb0-92f5-4ad9d0d0e51a admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:30.655237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e0d3-d0ee-4bb0-92f5-4ad9d0d0e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:30.655709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e0d3-d0ee-4bb0-92f5-4ad9d0d0e51a admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:30.657834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e0d3-d0ee-4bb0-92f5-4ad9d0d0e51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:30.662139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e0d3-d0ee-4bb0-92f5-4ad9d0d0e51a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:30.709927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 921/1854] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:30.711586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35615d-094b-40d9-9970-db12787f1327 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:30.730299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35615d-094b-40d9-9970-db12787f1327 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:30.747991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fa1d6-ba17-441d-99c8-bf259dfe9baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:30.749434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa1d6-ba17-441d-99c8-bf259dfe9baa admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:30.749784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa1d6-ba17-441d-99c8-bf259dfe9baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:30.750067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa1d6-ba17-441d-99c8-bf259dfe9baa admin admin] PATH_INFO: `/v3/projects/db57282f1eba43f1a016db9a3981dc9d/users/40003c1f9922454eaa80dd5f114f7c70/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:30.778309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e0d3-d0ee-4bb0-92f5-4ad9d0d0e51a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:30.780479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5b85e0d3-d0ee-4bb0-92f5-4ad9d0d0e51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:30.796739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fa1d6-ba17-441d-99c8-bf259dfe9baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=db57282f1eba43f1a016db9a3981dc9d, user_id=40003c1f9922454eaa80dd5f114f7c70, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:30.803888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e0d3-d0ee-4bb0-92f5-4ad9d0d0e51a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:30.807678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fa1d6-ba17-441d-99c8-bf259dfe9baa admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:30.817822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:30.818925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:30.819304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:30.819789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] PATH_INFO: `/v3/users/02197d5b80f642b5be98d313aff29dcc` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:30.821196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=02197d5b80f642b5be98d313aff29dcc)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:30.824367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:30.838706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 934/1855] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:30 2022] PUT /identity/v3/projects/db57282f1eba43f1a016db9a3981dc9d/users/40003c1f9922454eaa80dd5f114f7c70/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:30.839657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fa1d6-ba17-441d-99c8-bf259dfe9baa admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:30.946098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02197d5b80f642b5be98d313aff29dcc'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:30.969970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02197d5b80f642b5be98d313aff29dcc'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:30.971256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02197d5b80f642b5be98d313aff29dcc'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:30.971781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02197d5b80f642b5be98d313aff29dcc'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:30.981269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fa1d6-ba17-441d-99c8-bf259dfe9baa admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:30.985429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-58249e31-c1f8-4731-849e-dca1cd26a53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02197d5b80f642b5be98d313aff29dcc'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:30.991104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e46bd-ce66-4568-8d21-d02624e32fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:30.992040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e46bd-ce66-4568-8d21-d02624e32fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:30.992529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e46bd-ce66-4568-8d21-d02624e32fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:30.992998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e46bd-ce66-4568-8d21-d02624e32fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:30.994046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e46bd-ce66-4568-8d21-d02624e32fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:30.996434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e46bd-ce66-4568-8d21-d02624e32fa6 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:31.008262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 922/1856] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:30 2022] DELETE /identity/v3/users/02197d5b80f642b5be98d313aff29dcc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:31.013457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2798ba-e5d6-4ff4-87ec-afdd99ac86d6 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:31.013764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2798ba-e5d6-4ff4-87ec-afdd99ac86d6 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:31.014004 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2798ba-e5d6-4ff4-87ec-afdd99ac86d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:31.030074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 935/1857] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:31.031516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e46bd-ce66-4568-8d21-d02624e32fa6 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:31.033146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6d6e46bd-ce66-4568-8d21-d02624e32fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:31.049032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8e2798ba-e5d6-4ff4-87ec-afdd99ac86d6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:31.050305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8e2798ba-e5d6-4ff4-87ec-afdd99ac86d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:31.056332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e46bd-ce66-4568-8d21-d02624e32fa6 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:31.153131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065506-221f-4158-bd3a-9042816dc962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:31.154155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065506-221f-4158-bd3a-9042816dc962 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:31.157357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065506-221f-4158-bd3a-9042816dc962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:31.157589 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 923/1858] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:31.157669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065506-221f-4158-bd3a-9042816dc962 admin admin] PATH_INFO: `/v3/projects/db57282f1eba43f1a016db9a3981dc9d/users/40003c1f9922454eaa80dd5f114f7c70/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:31.157669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b065506-221f-4158-bd3a-9042816dc962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db57282f1eba43f1a016db9a3981dc9d, user_id=40003c1f9922454eaa80dd5f114f7c70, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:31.160116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b065506-221f-4158-bd3a-9042816dc962 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:31.165986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2798ba-e5d6-4ff4-87ec-afdd99ac86d6 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:31.167658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8e2798ba-e5d6-4ff4-87ec-afdd99ac86d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:31.178496 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 936/1859] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:31 2022] PUT /identity/v3/projects/db57282f1eba43f1a016db9a3981dc9d/users/40003c1f9922454eaa80dd5f114f7c70/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:31.301801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2798ba-e5d6-4ff4-87ec-afdd99ac86d6 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:31.394807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9c449-1ef4-4611-b64d-87a49b8fcf11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:31.395704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c449-1ef4-4611-b64d-87a49b8fcf11 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:31.396009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c449-1ef4-4611-b64d-87a49b8fcf11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:31.396727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c449-1ef4-4611-b64d-87a49b8fcf11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:31.539135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9c449-1ef4-4611-b64d-87a49b8fcf11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:31.541020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9c449-1ef4-4611-b64d-87a49b8fcf11 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:31.553233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 924/1860] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:57:31.863524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065506-221f-4158-bd3a-9042816dc962 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:31.866647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6b065506-221f-4158-bd3a-9042816dc962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:31.888756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065506-221f-4158-bd3a-9042816dc962 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:31.904656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:31.905832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:31.906122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:31.909241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] PATH_INFO: `/v3/projects/dce88c9df2d94837bc6b499c194209f3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:31.914013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce88c9df2d94837bc6b499c194209f3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:31.918375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:32.013901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce88c9df2d94837bc6b499c194209f3', 'request_id': 'req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.031105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce88c9df2d94837bc6b499c194209f3', 'request_id': 'req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.044598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce88c9df2d94837bc6b499c194209f3', 'request_id': 'req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.062473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] The token cache is being invalidate because project dce88c9df2d94837bc6b499c194209f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:32.063019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.063787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.066475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 937/1861] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:31 2022] DELETE /identity/v3/projects/dce88c9df2d94837bc6b499c194209f3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:32.070853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9c449-1ef4-4611-b64d-87a49b8fcf11 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:32.089358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9c449-1ef4-4611-b64d-87a49b8fcf11 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:32.201914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:32.202831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:32.203107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:32.203386 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] PATH_INFO: `/v3/users/87489e19ebd44e8eb8f1fc100c911da7` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:32.204929 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=87489e19ebd44e8eb8f1fc100c911da7)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:32.210646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:32.232927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:32.234773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:32.281411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dbfd8-bb0b-4cff-a845-5bd9341f4cec admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:32.307467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:32.308366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:32.308659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:32.308973 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] PATH_INFO: `/v3/projects/5ed0bfe300ff46a0ab3a91822b362420` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:32.314209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed0bfe300ff46a0ab3a91822b362420)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:32.316342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:32.352722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87489e19ebd44e8eb8f1fc100c911da7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.362084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87489e19ebd44e8eb8f1fc100c911da7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.364856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87489e19ebd44e8eb8f1fc100c911da7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.365519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87489e19ebd44e8eb8f1fc100c911da7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.381350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87489e19ebd44e8eb8f1fc100c911da7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.426973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 925/1862] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:32 2022] DELETE /identity/v3/users/87489e19ebd44e8eb8f1fc100c911da7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:32.430373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed0bfe300ff46a0ab3a91822b362420', 'request_id': 'req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.441842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed0bfe300ff46a0ab3a91822b362420', 'request_id': 'req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.449716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed0bfe300ff46a0ab3a91822b362420', 'request_id': 'req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.466699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] The token cache is being invalidate because project 5ed0bfe300ff46a0ab3a91822b362420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:32.467878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.468723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-afcf6f43-5ee3-42af-bd19-bc3a1c80af73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.472342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 938/1863] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:32 2022] DELETE /identity/v3/projects/5ed0bfe300ff46a0ab3a91822b362420 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:32.476345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:32.477885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:32.595338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290ad8d-a464-44c2-8cb1-3cacc137c3ee admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:32.602571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:32.603618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:32.603895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:32.604167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] PATH_INFO: `/v3/users/c4444323708c45e4bd23ebbb5db20836` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:32.605582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4444323708c45e4bd23ebbb5db20836)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:32.607519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:32.692987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4444323708c45e4bd23ebbb5db20836'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.705748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4444323708c45e4bd23ebbb5db20836'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.706632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4444323708c45e4bd23ebbb5db20836'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.707146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4444323708c45e4bd23ebbb5db20836'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.717080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4444323708c45e4bd23ebbb5db20836'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:32.737807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 926/1864] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:32 2022] DELETE /identity/v3/users/c4444323708c45e4bd23ebbb5db20836 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:33.294507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fb6a7-8b3d-48ff-8301-60ef0b3301f9 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:33.295445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fb6a7-8b3d-48ff-8301-60ef0b3301f9 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:33.295916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fb6a7-8b3d-48ff-8301-60ef0b3301f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:33.352986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-223fb6a7-8b3d-48ff-8301-60ef0b3301f9 None None] MFA Rules not processed for user `40003c1f9922454eaa80dd5f114f7c70`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:33.356044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-223fb6a7-8b3d-48ff-8301-60ef0b3301f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:33.386831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:33.388423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:33.558083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02e58e-66af-409f-b1b1-258c3390fc0f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:33.565784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:33.579527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:33.580705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:33.581130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] PATH_INFO: `/v3/projects/630541d7c09841dfba8202c72236fa1d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:33.583321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630541d7c09841dfba8202c72236fa1d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:33.586149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:33.644374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 939/1865] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:33.672439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fb6a7-8b3d-48ff-8301-60ef0b3301f9 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:33.674246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-223fb6a7-8b3d-48ff-8301-60ef0b3301f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:33.682522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630541d7c09841dfba8202c72236fa1d', 'request_id': 'req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:33.690477 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630541d7c09841dfba8202c72236fa1d', 'request_id': 'req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:33.702137 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630541d7c09841dfba8202c72236fa1d', 'request_id': 'req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:33.731529 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] The token cache is being invalidate because project 630541d7c09841dfba8202c72236fa1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:33.732139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:33.735519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-777ab22e-c64a-4a2f-984c-1ddce1d9ebf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:33.742113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 927/1866] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:33 2022] DELETE /identity/v3/projects/630541d7c09841dfba8202c72236fa1d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:33.744600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebf91c-ca09-4556-991b-0e83188425ba None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:33.745657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebf91c-ca09-4556-991b-0e83188425ba None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:33.746191 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebf91c-ca09-4556-991b-0e83188425ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:33.775008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-fdebf91c-ca09-4556-991b-0e83188425ba None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:33.786827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-fdebf91c-ca09-4556-991b-0e83188425ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:33.822518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fb6a7-8b3d-48ff-8301-60ef0b3301f9 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:33.909548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 928/1867] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:33.909778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c999-e804-4181-b380-aa51efc748a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:33.909778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c999-e804-4181-b380-aa51efc748a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:33.909778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c999-e804-4181-b380-aa51efc748a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:33.909778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c999-e804-4181-b380-aa51efc748a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:33.911956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3aa175-99bb-4ef2-b325-0e8063fb49a5 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:33.912391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3aa175-99bb-4ef2-b325-0e8063fb49a5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:33.912662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3aa175-99bb-4ef2-b325-0e8063fb49a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:33.914525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-81c6c999-e804-4181-b380-aa51efc748a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:33.937600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ff3aa175-99bb-4ef2-b325-0e8063fb49a5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:33.938978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ff3aa175-99bb-4ef2-b325-0e8063fb49a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:33.950951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 929/1868] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:33.951808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3aa175-99bb-4ef2-b325-0e8063fb49a5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:33.955947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ff3aa175-99bb-4ef2-b325-0e8063fb49a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:33.968642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3aa175-99bb-4ef2-b325-0e8063fb49a5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:33.974167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:33.975334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:33.975448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:33.975740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] PATH_INFO: `/v3/projects/d10f09ebb4cc4b3ab84fa781bf5a119d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:33.977163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10f09ebb4cc4b3ab84fa781bf5a119d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:33.979530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.034303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6c999-e804-4181-b380-aa51efc748a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.035954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6c999-e804-4181-b380-aa51efc748a9 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.061584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 940/1869] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:57:34.062430 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10f09ebb4cc4b3ab84fa781bf5a119d', 'request_id': 'req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:34.063268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c999-e804-4181-b380-aa51efc748a9 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.075343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10f09ebb4cc4b3ab84fa781bf5a119d', 'request_id': 'req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:34.088141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c999-e804-4181-b380-aa51efc748a9 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.088518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10f09ebb4cc4b3ab84fa781bf5a119d', 'request_id': 'req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:34.104997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] The token cache is being invalidate because project d10f09ebb4cc4b3ab84fa781bf5a119d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:34.105525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:34.106215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b91b8f3f-a36a-49ca-9a44-00a7d2a0bdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:34.112035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 930/1870] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:33 2022] DELETE /identity/v3/projects/d10f09ebb4cc4b3ab84fa781bf5a119d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:34.117882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3db3b-40c4-4012-828c-500dc53ebe10 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.118269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3db3b-40c4-4012-828c-500dc53ebe10 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.118834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3db3b-40c4-4012-828c-500dc53ebe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.162540 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-05e3db3b-40c4-4012-828c-500dc53ebe10 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:34.165150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-05e3db3b-40c4-4012-828c-500dc53ebe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:34.227989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.230754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.231044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.231324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.232378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:34.234070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.240464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.271351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 941/1871] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:34.281497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.283427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:34.307419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34518a3b-f619-4d9d-a42e-88d39321cfa3 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.317957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f011e-831c-4f80-af18-ca6936ccd4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.321091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f011e-831c-4f80-af18-ca6936ccd4ec admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.322162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f011e-831c-4f80-af18-ca6936ccd4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.328825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f011e-831c-4f80-af18-ca6936ccd4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.328825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f011e-831c-4f80-af18-ca6936ccd4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.328825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f011e-831c-4f80-af18-ca6936ccd4ec admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.329988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 931/1872] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:34.333309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef315-0f19-403d-ba88-1f3a0252f0c4 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.333913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef315-0f19-403d-ba88-1f3a0252f0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.334595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef315-0f19-403d-ba88-1f3a0252f0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.357202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-b59ef315-0f19-403d-ba88-1f3a0252f0c4 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:34.358883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b59ef315-0f19-403d-ba88-1f3a0252f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:34.373447 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 932/1873] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:34.374642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef315-0f19-403d-ba88-1f3a0252f0c4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.386211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef315-0f19-403d-ba88-1f3a0252f0c4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.391194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 942/1874] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:34 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:34.395092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f011e-831c-4f80-af18-ca6936ccd4ec admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.400430 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa7a74-c1f0-4a6f-a8da-e8c1677cf186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.401267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7a74-c1f0-4a6f-a8da-e8c1677cf186 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.401438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7a74-c1f0-4a6f-a8da-e8c1677cf186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.411106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7a74-c1f0-4a6f-a8da-e8c1677cf186 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.411106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa7a74-c1f0-4a6f-a8da-e8c1677cf186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:34.411106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa7a74-c1f0-4a6f-a8da-e8c1677cf186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.411106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa7a74-c1f0-4a6f-a8da-e8c1677cf186 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.425403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 933/1875] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:34.429912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa7a74-c1f0-4a6f-a8da-e8c1677cf186 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.443891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa7a74-c1f0-4a6f-a8da-e8c1677cf186 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.499513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f011e-831c-4f80-af18-ca6936ccd4ec admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.508887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816c32-44bd-4222-9e73-465e1b215379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.509671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816c32-44bd-4222-9e73-465e1b215379 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.510654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816c32-44bd-4222-9e73-465e1b215379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.510942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816c32-44bd-4222-9e73-465e1b215379 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.511682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816c32-44bd-4222-9e73-465e1b215379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.513718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816c32-44bd-4222-9e73-465e1b215379 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.525337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ce1ca-c77a-4c94-af2d-efec4f04ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.526158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ce1ca-c77a-4c94-af2d-efec4f04ba72 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.526411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ce1ca-c77a-4c94-af2d-efec4f04ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.526690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ce1ca-c77a-4c94-af2d-efec4f04ba72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.527415 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ce1ca-c77a-4c94-af2d-efec4f04ba72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.530260 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ce1ca-c77a-4c94-af2d-efec4f04ba72 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.565430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 943/1876] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:34 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:34.566576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816c32-44bd-4222-9e73-465e1b215379 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.568620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 934/1877] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:34 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:34.572984 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ce1ca-c77a-4c94-af2d-efec4f04ba72 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.587033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816c32-44bd-4222-9e73-465e1b215379 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.668735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ce1ca-c77a-4c94-af2d-efec4f04ba72 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.676001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e3502-cf0e-4ac8-b438-3c131ab7ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.677242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e3502-cf0e-4ac8-b438-3c131ab7ef07 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.678053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e3502-cf0e-4ac8-b438-3c131ab7ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.678505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e3502-cf0e-4ac8-b438-3c131ab7ef07 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.680353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e3502-cf0e-4ac8-b438-3c131ab7ef07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.682615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e3502-cf0e-4ac8-b438-3c131ab7ef07 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.687189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6c249-a30d-404e-a700-a2256a89e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.689748 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6c249-a30d-404e-a700-a2256a89e029 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.690232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6c249-a30d-404e-a700-a2256a89e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.691262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6c249-a30d-404e-a700-a2256a89e029 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.692645 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6c249-a30d-404e-a700-a2256a89e029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.694876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6c249-a30d-404e-a700-a2256a89e029 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.708978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 944/1878] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:34.713186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6c249-a30d-404e-a700-a2256a89e029 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.724396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 935/1879] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:34 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:34.725638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6c249-a30d-404e-a700-a2256a89e029 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.728570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e3502-cf0e-4ac8-b438-3c131ab7ef07 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.733838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3717d4-e7c5-44c9-8aa7-03f6ef242d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.735068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3717d4-e7c5-44c9-8aa7-03f6ef242d67 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.735493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3717d4-e7c5-44c9-8aa7-03f6ef242d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.735937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3717d4-e7c5-44c9-8aa7-03f6ef242d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.736977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3717d4-e7c5-44c9-8aa7-03f6ef242d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.739620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3717d4-e7c5-44c9-8aa7-03f6ef242d67 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.740492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e3502-cf0e-4ac8-b438-3c131ab7ef07 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.746657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b18f90-db9f-4b7a-960a-7b44b6e1c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.747639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b18f90-db9f-4b7a-960a-7b44b6e1c837 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.748081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b18f90-db9f-4b7a-960a-7b44b6e1c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.748719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b18f90-db9f-4b7a-960a-7b44b6e1c837 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.750097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b18f90-db9f-4b7a-960a-7b44b6e1c837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.752676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 945/1880] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:34.752925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b18f90-db9f-4b7a-960a-7b44b6e1c837 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.758132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3717d4-e7c5-44c9-8aa7-03f6ef242d67 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.770671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 936/1881] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:34.772287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b18f90-db9f-4b7a-960a-7b44b6e1c837 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.774079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3717d4-e7c5-44c9-8aa7-03f6ef242d67 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.781063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3736c-22de-4f59-b9d5-8febb8139f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.782967 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3736c-22de-4f59-b9d5-8febb8139f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.783325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3736c-22de-4f59-b9d5-8febb8139f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.784005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3736c-22de-4f59-b9d5-8febb8139f20 admin admin] PATH_INFO: `/v3/projects/96797ec6e642411c9b32bcc61f4a12f8/users/570dc43008a44f0e90c4ec4c22e1655a/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.784513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b18f90-db9f-4b7a-960a-7b44b6e1c837 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.791311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bebe03-c581-4537-89f4-e7b67fc83bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.792154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bebe03-c581-4537-89f4-e7b67fc83bfd admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.792435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bebe03-c581-4537-89f4-e7b67fc83bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.792717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bebe03-c581-4537-89f4-e7b67fc83bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.793556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bebe03-c581-4537-89f4-e7b67fc83bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.795311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bebe03-c581-4537-89f4-e7b67fc83bfd admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.808673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3736c-22de-4f59-b9d5-8febb8139f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96797ec6e642411c9b32bcc61f4a12f8, user_id=570dc43008a44f0e90c4ec4c22e1655a, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.812460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3736c-22de-4f59-b9d5-8febb8139f20 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.818774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 937/1882] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:34.823627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bebe03-c581-4537-89f4-e7b67fc83bfd admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.841031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 946/1883] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:34 2022] PUT /identity/v3/projects/96797ec6e642411c9b32bcc61f4a12f8/users/570dc43008a44f0e90c4ec4c22e1655a/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:34.845828 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0314a-27d7-44a5-9865-dc6d2a29e36e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.846123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0314a-27d7-44a5-9865-dc6d2a29e36e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.848068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0314a-27d7-44a5-9865-dc6d2a29e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.851713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bebe03-c581-4537-89f4-e7b67fc83bfd admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.884895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-0ad0314a-27d7-44a5-9865-dc6d2a29e36e None None] MFA Rules not processed for user `570dc43008a44f0e90c4ec4c22e1655a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:34.886486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0ad0314a-27d7-44a5-9865-dc6d2a29e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:34.932584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e94ea-246a-4e12-9810-c74bfe729c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:34.933861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e94ea-246a-4e12-9810-c74bfe729c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.935062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e94ea-246a-4e12-9810-c74bfe729c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.935559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e94ea-246a-4e12-9810-c74bfe729c1f admin admin] PATH_INFO: `/v3/projects/26bc7abcd2444e079fff08f2bc001986/users/08e1daa5bde54a7d8b9447fe5976ee8c/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:34.954711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e94ea-246a-4e12-9810-c74bfe729c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bc7abcd2444e079fff08f2bc001986, user_id=08e1daa5bde54a7d8b9447fe5976ee8c, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:34.958022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 947/1884] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:34.960871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e94ea-246a-4e12-9810-c74bfe729c1f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:34.962774 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0314a-27d7-44a5-9865-dc6d2a29e36e None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:34.979252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0314a-27d7-44a5-9865-dc6d2a29e36e None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:34.981197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 938/1885] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:34 2022] PUT /identity/v3/projects/26bc7abcd2444e079fff08f2bc001986/users/08e1daa5bde54a7d8b9447fe5976ee8c/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:34.993217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb63d-f6d9-4a3f-9e02-488a47e4d5b3 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:34.993529 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb63d-f6d9-4a3f-9e02-488a47e4d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:34.993854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb63d-f6d9-4a3f-9e02-488a47e4d5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.038829 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-84adb63d-f6d9-4a3f-9e02-488a47e4d5b3 None None] MFA Rules not processed for user `08e1daa5bde54a7d8b9447fe5976ee8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:35.040264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-84adb63d-f6d9-4a3f-9e02-488a47e4d5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:35.045609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1cbbb-4d8d-4bf1-ab89-138747727a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.046291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1cbbb-4d8d-4bf1-ab89-138747727a3f admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.046575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1cbbb-4d8d-4bf1-ab89-138747727a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.046853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1cbbb-4d8d-4bf1-ab89-138747727a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.047559 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1cbbb-4d8d-4bf1-ab89-138747727a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.049506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1cbbb-4d8d-4bf1-ab89-138747727a3f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.076369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 948/1886] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:34 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:35.081054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1cbbb-4d8d-4bf1-ab89-138747727a3f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.111073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 939/1887] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:35.116385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adb63d-f6d9-4a3f-9e02-488a47e4d5b3 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.129897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adb63d-f6d9-4a3f-9e02-488a47e4d5b3 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.153858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1cbbb-4d8d-4bf1-ab89-138747727a3f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.158491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba4d58-be42-4486-a4f4-28bf2b9c06b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.159167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba4d58-be42-4486-a4f4-28bf2b9c06b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.159453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba4d58-be42-4486-a4f4-28bf2b9c06b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.159713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba4d58-be42-4486-a4f4-28bf2b9c06b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.160402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba4d58-be42-4486-a4f4-28bf2b9c06b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.162385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba4d58-be42-4486-a4f4-28bf2b9c06b9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.186179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 949/1888] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:35 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:35.192114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba4d58-be42-4486-a4f4-28bf2b9c06b9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.200123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22a79b-d509-4a9a-a70c-108c70e54536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.200806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22a79b-d509-4a9a-a70c-108c70e54536 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.201779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22a79b-d509-4a9a-a70c-108c70e54536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.202059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22a79b-d509-4a9a-a70c-108c70e54536 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.202755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22a79b-d509-4a9a-a70c-108c70e54536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.203430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba4d58-be42-4486-a4f4-28bf2b9c06b9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.205049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22a79b-d509-4a9a-a70c-108c70e54536 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.208445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219166-4577-42c8-a240-cd338bbeeb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.209125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219166-4577-42c8-a240-cd338bbeeb19 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.209972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219166-4577-42c8-a240-cd338bbeeb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.209972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219166-4577-42c8-a240-cd338bbeeb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.211123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219166-4577-42c8-a240-cd338bbeeb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.212829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219166-4577-42c8-a240-cd338bbeeb19 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.227908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 950/1889] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:35.232004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219166-4577-42c8-a240-cd338bbeeb19 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.238087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 940/1890] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:35 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:35.242162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22a79b-d509-4a9a-a70c-108c70e54536 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.242818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219166-4577-42c8-a240-cd338bbeeb19 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.305453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70940a8e-1ac7-45e8-8dbb-0c9d2bdc1fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.306467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22a79b-d509-4a9a-a70c-108c70e54536 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.307041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70940a8e-1ac7-45e8-8dbb-0c9d2bdc1fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.307581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70940a8e-1ac7-45e8-8dbb-0c9d2bdc1fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.308205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70940a8e-1ac7-45e8-8dbb-0c9d2bdc1fb4 admin admin] PATH_INFO: `/v3/projects/c84843f5407e4c549328b7897a80becf/users/64efc6dbe6d94ef0854ea196ae3439b0/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.311957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c16569-306b-4803-91f9-ba863cb6f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.314520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c16569-306b-4803-91f9-ba863cb6f265 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.314979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c16569-306b-4803-91f9-ba863cb6f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.315261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c16569-306b-4803-91f9-ba863cb6f265 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.316225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c16569-306b-4803-91f9-ba863cb6f265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.317968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c16569-306b-4803-91f9-ba863cb6f265 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.323747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70940a8e-1ac7-45e8-8dbb-0c9d2bdc1fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84843f5407e4c549328b7897a80becf, user_id=64efc6dbe6d94ef0854ea196ae3439b0, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.326634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70940a8e-1ac7-45e8-8dbb-0c9d2bdc1fb4 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.340686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 951/1891] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:35 2022] PUT /identity/v3/projects/c84843f5407e4c549328b7897a80becf/users/64efc6dbe6d94ef0854ea196ae3439b0/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:35.343777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 941/1892] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:35 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:35.344819 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c16569-306b-4803-91f9-ba863cb6f265 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.345899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70940a8e-1ac7-45e8-8dbb-0c9d2bdc1fb4 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.354908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c16569-306b-4803-91f9-ba863cb6f265 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.456525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276cdd0-25ea-44fe-ac2c-eca7fafce354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.461199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276cdd0-25ea-44fe-ac2c-eca7fafce354 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.461627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276cdd0-25ea-44fe-ac2c-eca7fafce354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.461993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276cdd0-25ea-44fe-ac2c-eca7fafce354 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.462963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276cdd0-25ea-44fe-ac2c-eca7fafce354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.465562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276cdd0-25ea-44fe-ac2c-eca7fafce354 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.468707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70940a8e-1ac7-45e8-8dbb-0c9d2bdc1fb4 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.476012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e37e5-0785-405b-9f6a-1ff0d6ca7b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.476667 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e37e5-0785-405b-9f6a-1ff0d6ca7b0b admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.477195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 942/1893] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:35.480254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e37e5-0785-405b-9f6a-1ff0d6ca7b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.480559 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e37e5-0785-405b-9f6a-1ff0d6ca7b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.481356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e37e5-0785-405b-9f6a-1ff0d6ca7b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.482106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276cdd0-25ea-44fe-ac2c-eca7fafce354 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.483077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e37e5-0785-405b-9f6a-1ff0d6ca7b0b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.493740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 952/1894] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:35.495465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276cdd0-25ea-44fe-ac2c-eca7fafce354 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.498598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e37e5-0785-405b-9f6a-1ff0d6ca7b0b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.500928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4ae91-b13d-463d-a3f3-46b9ae54985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.502043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ae91-b13d-463d-a3f3-46b9ae54985b admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.502331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ae91-b13d-463d-a3f3-46b9ae54985b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.502607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ae91-b13d-463d-a3f3-46b9ae54985b admin admin] PATH_INFO: `/v3/projects/161688b75b944b12933bb514d801b79d/users/5c561064765e4a829fff9028a8e5887f/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.510099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e37e5-0785-405b-9f6a-1ff0d6ca7b0b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.515408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630d4a1-b6b6-46d9-bb35-73fab355bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.516607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d4a1-b6b6-46d9-bb35-73fab355bf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.516983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d4a1-b6b6-46d9-bb35-73fab355bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.517398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d4a1-b6b6-46d9-bb35-73fab355bf8d admin admin] PATH_INFO: `/v3/projects/c84843f5407e4c549328b7897a80becf/users/64efc6dbe6d94ef0854ea196ae3439b0/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.518659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4ae91-b13d-463d-a3f3-46b9ae54985b admin admin] RBAC: Authorizing `identity:create_grant(project_id=161688b75b944b12933bb514d801b79d, user_id=5c561064765e4a829fff9028a8e5887f, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.520035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630d4a1-b6b6-46d9-bb35-73fab355bf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84843f5407e4c549328b7897a80becf, user_id=64efc6dbe6d94ef0854ea196ae3439b0, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.521358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4ae91-b13d-463d-a3f3-46b9ae54985b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.522633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630d4a1-b6b6-46d9-bb35-73fab355bf8d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.535961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 953/1895] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:35 2022] PUT /identity/v3/projects/c84843f5407e4c549328b7897a80becf/users/64efc6dbe6d94ef0854ea196ae3439b0/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:35.536224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 943/1896] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:35 2022] PUT /identity/v3/projects/161688b75b944b12933bb514d801b79d/users/5c561064765e4a829fff9028a8e5887f/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:35.542541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630d4a1-b6b6-46d9-bb35-73fab355bf8d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.549224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916543-fff7-4a57-bd80-e891a7345757 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.550321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916543-fff7-4a57-bd80-e891a7345757 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.550620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916543-fff7-4a57-bd80-e891a7345757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.598423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-38916543-fff7-4a57-bd80-e891a7345757 None None] MFA Rules not processed for user `64efc6dbe6d94ef0854ea196ae3439b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:35.599639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-38916543-fff7-4a57-bd80-e891a7345757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:35.616849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630d4a1-b6b6-46d9-bb35-73fab355bf8d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.671868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 944/1897] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:35.677636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509845a-e1ba-40c7-834e-c81db00aba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.679124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509845a-e1ba-40c7-834e-c81db00aba2b admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.679568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509845a-e1ba-40c7-834e-c81db00aba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.679998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509845a-e1ba-40c7-834e-c81db00aba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.680899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509845a-e1ba-40c7-834e-c81db00aba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.682945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509845a-e1ba-40c7-834e-c81db00aba2b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.684549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916543-fff7-4a57-bd80-e891a7345757 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.686562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-38916543-fff7-4a57-bd80-e891a7345757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:35.696836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 954/1898] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:35.700874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509845a-e1ba-40c7-834e-c81db00aba2b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.713460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509845a-e1ba-40c7-834e-c81db00aba2b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.719312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59359821-93a1-41c2-90bb-bd14eb4aa2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.728893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59359821-93a1-41c2-90bb-bd14eb4aa2fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.728893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59359821-93a1-41c2-90bb-bd14eb4aa2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.728893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59359821-93a1-41c2-90bb-bd14eb4aa2fe admin admin] PATH_INFO: `/v3/projects/161688b75b944b12933bb514d801b79d/users/5c561064765e4a829fff9028a8e5887f/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.728893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59359821-93a1-41c2-90bb-bd14eb4aa2fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=161688b75b944b12933bb514d801b79d, user_id=5c561064765e4a829fff9028a8e5887f, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.728893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59359821-93a1-41c2-90bb-bd14eb4aa2fe admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.737682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 955/1899] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:35 2022] PUT /identity/v3/projects/161688b75b944b12933bb514d801b79d/users/5c561064765e4a829fff9028a8e5887f/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:35.748662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde7399-3e69-4c4b-a8a0-26bb90e51143 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.748950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde7399-3e69-4c4b-a8a0-26bb90e51143 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.749416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde7399-3e69-4c4b-a8a0-26bb90e51143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.769380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916543-fff7-4a57-bd80-e891a7345757 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.780565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-acde7399-3e69-4c4b-a8a0-26bb90e51143 None None] MFA Rules not processed for user `5c561064765e4a829fff9028a8e5887f`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:35.782197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-acde7399-3e69-4c4b-a8a0-26bb90e51143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:35.836246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4ba79-64dc-4ec9-a2b2-30513a2e378c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.838067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4ba79-64dc-4ec9-a2b2-30513a2e378c service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.838507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4ba79-64dc-4ec9-a2b2-30513a2e378c service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.839937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4ba79-64dc-4ec9-a2b2-30513a2e378c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.876494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 956/1900] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:35.877606 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde7399-3e69-4c4b-a8a0-26bb90e51143 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:35.879386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-acde7399-3e69-4c4b-a8a0-26bb90e51143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:35.891602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde7399-3e69-4c4b-a8a0-26bb90e51143 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:35.896009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669b099-c89b-4d3f-8896-07e7da0b2206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:35.896793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669b099-c89b-4d3f-8896-07e7da0b2206 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:35.897176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669b099-c89b-4d3f-8896-07e7da0b2206 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:35.897583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669b099-c89b-4d3f-8896-07e7da0b2206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:35.899554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e669b099-c89b-4d3f-8896-07e7da0b2206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:35.933134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4ba79-64dc-4ec9-a2b2-30513a2e378c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.935229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4ba79-64dc-4ec9-a2b2-30513a2e378c service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:35.958765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 945/1901] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:57:35.986890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669b099-c89b-4d3f-8896-07e7da0b2206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:35.988492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669b099-c89b-4d3f-8896-07e7da0b2206 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:36.000273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 957/1902] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:36.071086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4ba79-64dc-4ec9-a2b2-30513a2e378c service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:36.080939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4ba79-64dc-4ec9-a2b2-30513a2e378c service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:36.084897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bfe1d-2f73-44ee-af02-7ef0a65dd926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:36.085610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bfe1d-2f73-44ee-af02-7ef0a65dd926 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:36.085986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bfe1d-2f73-44ee-af02-7ef0a65dd926 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:36.086339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bfe1d-2f73-44ee-af02-7ef0a65dd926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:36.097392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bfe1d-2f73-44ee-af02-7ef0a65dd926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:36.098668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bfe1d-2f73-44ee-af02-7ef0a65dd926 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:36.109537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 946/1903] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:36.126917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669b099-c89b-4d3f-8896-07e7da0b2206 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:36.136275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669b099-c89b-4d3f-8896-07e7da0b2206 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:36.140269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba04d6e-eba0-407d-9d72-2b0d2465b21d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:36.141016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba04d6e-eba0-407d-9d72-2b0d2465b21d service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:36.141419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba04d6e-eba0-407d-9d72-2b0d2465b21d service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:36.141764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba04d6e-eba0-407d-9d72-2b0d2465b21d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:36.208952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba04d6e-eba0-407d-9d72-2b0d2465b21d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:36.211323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba04d6e-eba0-407d-9d72-2b0d2465b21d service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:36.222790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 958/1904] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:36.317524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bfe1d-2f73-44ee-af02-7ef0a65dd926 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:36.396495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bfe1d-2f73-44ee-af02-7ef0a65dd926 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:36.400965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:36.402000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:36.402298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:36.402679 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] PATH_INFO: `/v3/users/08e1daa5bde54a7d8b9447fe5976ee8c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:36.404066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e1daa5bde54a7d8b9447fe5976ee8c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:36.405868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:36.470413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e1daa5bde54a7d8b9447fe5976ee8c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:36.480135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e1daa5bde54a7d8b9447fe5976ee8c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:36.481006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e1daa5bde54a7d8b9447fe5976ee8c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:36.482457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e1daa5bde54a7d8b9447fe5976ee8c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:36.496050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e1daa5bde54a7d8b9447fe5976ee8c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:36.524154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 947/1905] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:36 2022] DELETE /identity/v3/users/08e1daa5bde54a7d8b9447fe5976ee8c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:36.529865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf494d2-a617-4ce1-ab66-1163560bfb58 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:36.529865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf494d2-a617-4ce1-ab66-1163560bfb58 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:36.529865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf494d2-a617-4ce1-ab66-1163560bfb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:36.563512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3cf494d2-a617-4ce1-ab66-1163560bfb58 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:36.564804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3cf494d2-a617-4ce1-ab66-1163560bfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:36.674673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 959/1906] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:36.691845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:36.693563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:36.757118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788fa46-4252-4926-b1a8-a98f88bef5c6 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:36.761261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaba52-47a2-4b3f-aafb-071663030cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:36.761962 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaba52-47a2-4b3f-aafb-071663030cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:36.762241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaba52-47a2-4b3f-aafb-071663030cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:36.763115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaba52-47a2-4b3f-aafb-071663030cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:36.774461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaba52-47a2-4b3f-aafb-071663030cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:36.776218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaba52-47a2-4b3f-aafb-071663030cb2 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:36.786966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 948/1907] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:37.057465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf494d2-a617-4ce1-ab66-1163560bfb58 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:37.059182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3cf494d2-a617-4ce1-ab66-1163560bfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:37.081596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf494d2-a617-4ce1-ab66-1163560bfb58 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:37.088365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:37.089465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:37.089764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:37.090018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] PATH_INFO: `/v3/projects/26bc7abcd2444e079fff08f2bc001986` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:37.098567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26bc7abcd2444e079fff08f2bc001986)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:37.100797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:37.156663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26bc7abcd2444e079fff08f2bc001986', 'request_id': 'req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.166393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26bc7abcd2444e079fff08f2bc001986', 'request_id': 'req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.174354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26bc7abcd2444e079fff08f2bc001986', 'request_id': 'req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.185695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] The token cache is being invalidate because project 26bc7abcd2444e079fff08f2bc001986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:37.185980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.186665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.188342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 960/1908] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:37 2022] DELETE /identity/v3/projects/26bc7abcd2444e079fff08f2bc001986 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:37.192400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaba52-47a2-4b3f-aafb-071663030cb2 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:37.202013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaba52-47a2-4b3f-aafb-071663030cb2 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:37.274687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:37.275963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:37.276219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:37.276484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] PATH_INFO: `/v3/users/5c561064765e4a829fff9028a8e5887f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:37.277696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c561064765e4a829fff9028a8e5887f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:37.279614 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:37.334189 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c561064765e4a829fff9028a8e5887f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.352610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c561064765e4a829fff9028a8e5887f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.353557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c561064765e4a829fff9028a8e5887f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.354159 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c561064765e4a829fff9028a8e5887f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.365327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-53da3d6d-36d6-4045-9db6-7054e82b6fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c561064765e4a829fff9028a8e5887f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.390070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 949/1909] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:37 2022] DELETE /identity/v3/users/5c561064765e4a829fff9028a8e5887f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:37.750481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:37.752560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:37.780258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bd75-4a84-4e11-87f3-ccae4324f3b2 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:37.866507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:37.867806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:37.868084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:37.868353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] PATH_INFO: `/v3/projects/161688b75b944b12933bb514d801b79d` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:37.870382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] RBAC: Authorizing `identity:delete_project(project_id=161688b75b944b12933bb514d801b79d)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:37.872286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:37.953789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161688b75b944b12933bb514d801b79d', 'request_id': 'req-22e1816b-58f6-484b-a8c9-e4e92f43560c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.967340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161688b75b944b12933bb514d801b79d', 'request_id': 'req-22e1816b-58f6-484b-a8c9-e4e92f43560c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.980016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161688b75b944b12933bb514d801b79d', 'request_id': 'req-22e1816b-58f6-484b-a8c9-e4e92f43560c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.992497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] The token cache is being invalidate because project 161688b75b944b12933bb514d801b79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:37.992497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.994018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-22e1816b-58f6-484b-a8c9-e4e92f43560c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:37.995904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 961/1910] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:37 2022] DELETE /identity/v3/projects/161688b75b944b12933bb514d801b79d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:38.004443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c792561-ccec-4814-994f-6114935e16f3 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.004960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c792561-ccec-4814-994f-6114935e16f3 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.005479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c792561-ccec-4814-994f-6114935e16f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.030422 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3c792561-ccec-4814-994f-6114935e16f3 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:38.031764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3c792561-ccec-4814-994f-6114935e16f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:38.169043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 950/1911] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:38.177248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0a274-98a9-4e9b-a65c-bc440c49ff91 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.177568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0a274-98a9-4e9b-a65c-bc440c49ff91 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.177902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0a274-98a9-4e9b-a65c-bc440c49ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.205253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e8e0a274-98a9-4e9b-a65c-bc440c49ff91 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:38.206624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e8e0a274-98a9-4e9b-a65c-bc440c49ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:38.219762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 962/1912] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:38.225834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c792561-ccec-4814-994f-6114935e16f3 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:38.243913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c792561-ccec-4814-994f-6114935e16f3 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:38.258862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b341-8098-4b32-a47b-6153571e4460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:38.259743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b341-8098-4b32-a47b-6153571e4460 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.259896 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b341-8098-4b32-a47b-6153571e4460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.260172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b341-8098-4b32-a47b-6153571e4460 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.262656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b341-8098-4b32-a47b-6153571e4460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:38.264001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b341-8098-4b32-a47b-6153571e4460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:38.266683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b341-8098-4b32-a47b-6153571e4460 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:38.305102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 951/1913] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:57:38.305361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0a274-98a9-4e9b-a65c-bc440c49ff91 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:38.322613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0a274-98a9-4e9b-a65c-bc440c49ff91 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:38.333115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb717-e3a1-4c7d-9cd1-4e339ad5d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:38.334462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb717-e3a1-4c7d-9cd1-4e339ad5d5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.335064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb717-e3a1-4c7d-9cd1-4e339ad5d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.336490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb717-e3a1-4c7d-9cd1-4e339ad5d5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.337371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb717-e3a1-4c7d-9cd1-4e339ad5d5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:38.343259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb717-e3a1-4c7d-9cd1-4e339ad5d5a1 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:38.418598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 963/1914] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:38 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:38.419251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b341-8098-4b32-a47b-6153571e4460 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:38.434207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b341-8098-4b32-a47b-6153571e4460 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:38.564110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355578a3-fb7e-4965-a78a-88306540d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:38.566129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355578a3-fb7e-4965-a78a-88306540d800 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.566711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355578a3-fb7e-4965-a78a-88306540d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.567044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355578a3-fb7e-4965-a78a-88306540d800 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.568052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355578a3-fb7e-4965-a78a-88306540d800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:38.570211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355578a3-fb7e-4965-a78a-88306540d800 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:38.599677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 952/1915] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:38 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:57:38.612631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb717-e3a1-4c7d-9cd1-4e339ad5d5a1 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:38.624383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb717-e3a1-4c7d-9cd1-4e339ad5d5a1 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:38.629593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a617c-bff3-47c9-a27b-2f55a331e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:38.630356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a617c-bff3-47c9-a27b-2f55a331e91a admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.631994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a617c-bff3-47c9-a27b-2f55a331e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.631994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a617c-bff3-47c9-a27b-2f55a331e91a admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.631994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a617c-bff3-47c9-a27b-2f55a331e91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:38.633965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a617c-bff3-47c9-a27b-2f55a331e91a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:38.646992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 964/1916] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:38.652110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355578a3-fb7e-4965-a78a-88306540d800 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:38.662812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355578a3-fb7e-4965-a78a-88306540d800 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:38.669034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c754a9-2dfb-4a9b-b2ff-461dadd628d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:38.670326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c754a9-2dfb-4a9b-b2ff-461dadd628d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.670826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c754a9-2dfb-4a9b-b2ff-461dadd628d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.671341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c754a9-2dfb-4a9b-b2ff-461dadd628d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.672298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c754a9-2dfb-4a9b-b2ff-461dadd628d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:38.675005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c754a9-2dfb-4a9b-b2ff-461dadd628d6 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:38.700703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 953/1917] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:38.704769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a617c-bff3-47c9-a27b-2f55a331e91a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:38.721439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a617c-bff3-47c9-a27b-2f55a331e91a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:38.732907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60eefb-8204-44c7-863e-81aac214a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:38.733908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60eefb-8204-44c7-863e-81aac214a648 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.734182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60eefb-8204-44c7-863e-81aac214a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.734498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60eefb-8204-44c7-863e-81aac214a648 admin admin] PATH_INFO: `/v3/projects/f0b03b527658452babb41bb302254a32/users/bfbb893a8ee846a481d5c108fdabbe25/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.758300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60eefb-8204-44c7-863e-81aac214a648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b03b527658452babb41bb302254a32, user_id=bfbb893a8ee846a481d5c108fdabbe25, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:38.761577 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60eefb-8204-44c7-863e-81aac214a648 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:38.780913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 965/1918] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:38 2022] PUT /identity/v3/projects/f0b03b527658452babb41bb302254a32/users/bfbb893a8ee846a481d5c108fdabbe25/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:38.795481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fddbe7-75ff-4256-8a57-c8261caa0a15 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.795768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fddbe7-75ff-4256-8a57-c8261caa0a15 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.796052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fddbe7-75ff-4256-8a57-c8261caa0a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.823975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-80fddbe7-75ff-4256-8a57-c8261caa0a15 None None] MFA Rules not processed for user `bfbb893a8ee846a481d5c108fdabbe25`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:38.825255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-80fddbe7-75ff-4256-8a57-c8261caa0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:38.898951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 954/1919] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:38.903775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60eefb-8204-44c7-863e-81aac214a648 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:38.965801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60eefb-8204-44c7-863e-81aac214a648 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:38.970505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28179527-d9a2-4635-9274-34a8bf901b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:38.971179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28179527-d9a2-4635-9274-34a8bf901b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:38.971460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28179527-d9a2-4635-9274-34a8bf901b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:38.971775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28179527-d9a2-4635-9274-34a8bf901b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:38.972475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28179527-d9a2-4635-9274-34a8bf901b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:38.974420 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28179527-d9a2-4635-9274-34a8bf901b0b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:39.006404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 966/1920] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:38 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:39.007547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fddbe7-75ff-4256-8a57-c8261caa0a15 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:39.018372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fddbe7-75ff-4256-8a57-c8261caa0a15 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:39.073903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf378c-bb16-42a5-b3a6-44981b7362ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:39.074584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf378c-bb16-42a5-b3a6-44981b7362ad admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:39.074871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf378c-bb16-42a5-b3a6-44981b7362ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:39.075137 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf378c-bb16-42a5-b3a6-44981b7362ad admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:39.075840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf378c-bb16-42a5-b3a6-44981b7362ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:39.077803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf378c-bb16-42a5-b3a6-44981b7362ad admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:39.100377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 955/1921] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:39 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:39.104362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28179527-d9a2-4635-9274-34a8bf901b0b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:39.116653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28179527-d9a2-4635-9274-34a8bf901b0b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:39.125237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8221a-6fad-4926-835d-e455bd5a3183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:39.126081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8221a-6fad-4926-835d-e455bd5a3183 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:39.126448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8221a-6fad-4926-835d-e455bd5a3183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:39.126775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8221a-6fad-4926-835d-e455bd5a3183 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:39.127598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8221a-6fad-4926-835d-e455bd5a3183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:39.129455 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8221a-6fad-4926-835d-e455bd5a3183 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:39.165493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 967/1922] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:39.166313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf378c-bb16-42a5-b3a6-44981b7362ad admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:39.176141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf378c-bb16-42a5-b3a6-44981b7362ad admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:39.183327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486cecd-954d-4b7e-9516-83aca01b89da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:39.183490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cecd-954d-4b7e-9516-83aca01b89da admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:39.183769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cecd-954d-4b7e-9516-83aca01b89da admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:39.184045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cecd-954d-4b7e-9516-83aca01b89da admin admin] PATH_INFO: `/v3/projects/853695caa1304ee28f863ad1b853fd07/users/e5d0ad9784e942558a962f12215cf675/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:39.201185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486cecd-954d-4b7e-9516-83aca01b89da admin admin] RBAC: Authorizing `identity:create_grant(project_id=853695caa1304ee28f863ad1b853fd07, user_id=e5d0ad9784e942558a962f12215cf675, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:39.203889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486cecd-954d-4b7e-9516-83aca01b89da admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:39.220264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 956/1923] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:39 2022] PUT /identity/v3/projects/853695caa1304ee28f863ad1b853fd07/users/e5d0ad9784e942558a962f12215cf675/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:39.224182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8221a-6fad-4926-835d-e455bd5a3183 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:39.234509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8221a-6fad-4926-835d-e455bd5a3183 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:39.306757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59ecfb-1949-4c4e-a0d3-7f80798db8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:39.307734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ecfb-1949-4c4e-a0d3-7f80798db8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:39.308191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ecfb-1949-4c4e-a0d3-7f80798db8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:39.308666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ecfb-1949-4c4e-a0d3-7f80798db8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:39.309621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59ecfb-1949-4c4e-a0d3-7f80798db8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:39.311529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59ecfb-1949-4c4e-a0d3-7f80798db8a0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:39.324095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 968/1924] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:39.328869 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486cecd-954d-4b7e-9516-83aca01b89da admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:39.344272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486cecd-954d-4b7e-9516-83aca01b89da admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:39.350332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62a087-898f-43eb-a188-43d462c02442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:39.351300 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62a087-898f-43eb-a188-43d462c02442 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:39.351581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62a087-898f-43eb-a188-43d462c02442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:39.351937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62a087-898f-43eb-a188-43d462c02442 admin admin] PATH_INFO: `/v3/projects/853695caa1304ee28f863ad1b853fd07/users/e5d0ad9784e942558a962f12215cf675/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:39.353987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62a087-898f-43eb-a188-43d462c02442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853695caa1304ee28f863ad1b853fd07, user_id=e5d0ad9784e942558a962f12215cf675, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:39.356649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62a087-898f-43eb-a188-43d462c02442 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:39.373550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 957/1925] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:39 2022] PUT /identity/v3/projects/853695caa1304ee28f863ad1b853fd07/users/e5d0ad9784e942558a962f12215cf675/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:39.379332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d158-5662-4741-a1c0-c9d86df9374e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:39.379793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d158-5662-4741-a1c0-c9d86df9374e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:39.380742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d158-5662-4741-a1c0-c9d86df9374e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:39.409228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3eb9d158-5662-4741-a1c0-c9d86df9374e None None] MFA Rules not processed for user `e5d0ad9784e942558a962f12215cf675`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:39.410577 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3eb9d158-5662-4741-a1c0-c9d86df9374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:39.486055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 969/1926] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:39.497454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62a087-898f-43eb-a188-43d462c02442 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:39.499201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-fd62a087-898f-43eb-a188-43d462c02442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:39.557433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62a087-898f-43eb-a188-43d462c02442 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:39.562073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e51da6-75e0-4770-8886-605d3f3505c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:39.562824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e51da6-75e0-4770-8886-605d3f3505c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:39.563096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e51da6-75e0-4770-8886-605d3f3505c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:39.563377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e51da6-75e0-4770-8886-605d3f3505c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:39.574306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e51da6-75e0-4770-8886-605d3f3505c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:39.575734 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e51da6-75e0-4770-8886-605d3f3505c6 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:39.586353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 958/1927] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:39.684641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9d158-5662-4741-a1c0-c9d86df9374e None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:39.694711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9d158-5662-4741-a1c0-c9d86df9374e None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:39.699012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47eef4c-94c6-4c97-953b-68a2a72bbf36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:39.699656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eef4c-94c6-4c97-953b-68a2a72bbf36 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:39.699931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eef4c-94c6-4c97-953b-68a2a72bbf36 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:39.700199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eef4c-94c6-4c97-953b-68a2a72bbf36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:39.755249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47eef4c-94c6-4c97-953b-68a2a72bbf36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:39.756751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47eef4c-94c6-4c97-953b-68a2a72bbf36 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:39.766110 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 970/1928] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:40.301618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e51da6-75e0-4770-8886-605d3f3505c6 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:40.303386 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-19e51da6-75e0-4770-8886-605d3f3505c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:40.379242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e51da6-75e0-4770-8886-605d3f3505c6 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:40.384954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:40.385871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:40.386144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:40.386423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] PATH_INFO: `/v3/users/570dc43008a44f0e90c4ec4c22e1655a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:40.387684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=570dc43008a44f0e90c4ec4c22e1655a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:40.389616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:40.437367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570dc43008a44f0e90c4ec4c22e1655a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:40.444529 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570dc43008a44f0e90c4ec4c22e1655a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:40.445373 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570dc43008a44f0e90c4ec4c22e1655a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:40.446010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570dc43008a44f0e90c4ec4c22e1655a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:40.455365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570dc43008a44f0e90c4ec4c22e1655a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:40.472970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 959/1929] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:40 2022] DELETE /identity/v3/users/570dc43008a44f0e90c4ec4c22e1655a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:40.477536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce8ef8-a858-453a-bf1a-fd30c6f03b36 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:40.477825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce8ef8-a858-453a-bf1a-fd30c6f03b36 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:40.478100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce8ef8-a858-453a-bf1a-fd30c6f03b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:40.496092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-0bce8ef8-a858-453a-bf1a-fd30c6f03b36 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:40.497264 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0bce8ef8-a858-453a-bf1a-fd30c6f03b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:40.556122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 971/1930] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:40.566344 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:40.567993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:40.625191 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1e6d-69f4-419f-9314-9ec55ac63c72 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:40.628993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254640e-8edc-4a07-b7ba-733970cfd331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:40.629675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254640e-8edc-4a07-b7ba-733970cfd331 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:40.629954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254640e-8edc-4a07-b7ba-733970cfd331 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:40.630225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254640e-8edc-4a07-b7ba-733970cfd331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:40.639965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254640e-8edc-4a07-b7ba-733970cfd331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:40.641496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254640e-8edc-4a07-b7ba-733970cfd331 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:40.652354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 960/1931] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:40.987677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce8ef8-a858-453a-bf1a-fd30c6f03b36 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:40.989243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0bce8ef8-a858-453a-bf1a-fd30c6f03b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:41.002603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce8ef8-a858-453a-bf1a-fd30c6f03b36 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:41.007518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:41.008416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:41.008700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:41.008972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] PATH_INFO: `/v3/projects/96797ec6e642411c9b32bcc61f4a12f8` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:41.010340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] RBAC: Authorizing `identity:delete_project(project_id=96797ec6e642411c9b32bcc61f4a12f8)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:41.012355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:41.064628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96797ec6e642411c9b32bcc61f4a12f8', 'request_id': 'req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.074750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96797ec6e642411c9b32bcc61f4a12f8', 'request_id': 'req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.081225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96797ec6e642411c9b32bcc61f4a12f8', 'request_id': 'req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.091405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] The token cache is being invalidate because project 96797ec6e642411c9b32bcc61f4a12f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:41.091689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.092323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.093925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 972/1932] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:40 2022] DELETE /identity/v3/projects/96797ec6e642411c9b32bcc61f4a12f8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:41.098116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254640e-8edc-4a07-b7ba-733970cfd331 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:41.107811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254640e-8edc-4a07-b7ba-733970cfd331 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:41.165980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:41.166898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:41.167177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:41.167452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] PATH_INFO: `/v3/users/64efc6dbe6d94ef0854ea196ae3439b0` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:41.168643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] RBAC: Authorizing `identity:delete_user(user_id=64efc6dbe6d94ef0854ea196ae3439b0)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:41.170653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:41.216838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64efc6dbe6d94ef0854ea196ae3439b0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.223450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64efc6dbe6d94ef0854ea196ae3439b0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.224107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64efc6dbe6d94ef0854ea196ae3439b0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.224715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64efc6dbe6d94ef0854ea196ae3439b0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.233415 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f9badf9d-e46a-446e-97b0-e128c9a183df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64efc6dbe6d94ef0854ea196ae3439b0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.250547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 961/1933] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:41 2022] DELETE /identity/v3/users/64efc6dbe6d94ef0854ea196ae3439b0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:41.519830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:41.521274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:41.535843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52e58d-ff1d-40b7-bd91-dc5a324dffae admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:41.592635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:41.593550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:41.593831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:41.594282 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] PATH_INFO: `/v3/projects/c84843f5407e4c549328b7897a80becf` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:41.595475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84843f5407e4c549328b7897a80becf)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:41.597620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:41.645722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84843f5407e4c549328b7897a80becf', 'request_id': 'req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.656045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84843f5407e4c549328b7897a80becf', 'request_id': 'req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.663036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84843f5407e4c549328b7897a80becf', 'request_id': 'req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.674160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] The token cache is being invalidate because project c84843f5407e4c549328b7897a80becf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:41.674444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.675153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-9f37fa6b-dbd6-4113-bac0-9344d58ecc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:41.676788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 973/1934] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:41 2022] DELETE /identity/v3/projects/c84843f5407e4c549328b7897a80becf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:41.681911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5bbd-dad5-4b44-a3e2-0d3047a8bece None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:41.682387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5bbd-dad5-4b44-a3e2-0d3047a8bece None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:41.682471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5bbd-dad5-4b44-a3e2-0d3047a8bece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:41.699996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-73df5bbd-dad5-4b44-a3e2-0d3047a8bece None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:41.701215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-73df5bbd-dad5-4b44-a3e2-0d3047a8bece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:41.766352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 962/1935] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:41.774672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddf47a-d36a-40ca-8e4d-00c54e09527a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:41.774956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddf47a-d36a-40ca-8e4d-00c54e09527a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:41.775232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddf47a-d36a-40ca-8e4d-00c54e09527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:41.794039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-84ddf47a-d36a-40ca-8e4d-00c54e09527a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:41.795255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-84ddf47a-d36a-40ca-8e4d-00c54e09527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:41.803495 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 974/1936] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:41.808249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5bbd-dad5-4b44-a3e2-0d3047a8bece None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:41.819828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5bbd-dad5-4b44-a3e2-0d3047a8bece None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:41.825139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12929a18-f22e-4087-8dae-532d43cb4f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:41.825833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12929a18-f22e-4087-8dae-532d43cb4f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:41.826313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12929a18-f22e-4087-8dae-532d43cb4f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:41.826595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12929a18-f22e-4087-8dae-532d43cb4f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:41.827341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12929a18-f22e-4087-8dae-532d43cb4f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:41.827648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12929a18-f22e-4087-8dae-532d43cb4f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:41.829998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12929a18-f22e-4087-8dae-532d43cb4f5f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:41.843088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 963/1937] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:41.847641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddf47a-d36a-40ca-8e4d-00c54e09527a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:41.857434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddf47a-d36a-40ca-8e4d-00c54e09527a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:41.863702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f53b39-93d2-496e-9a8c-c8935b4a7d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:41.864511 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53b39-93d2-496e-9a8c-c8935b4a7d2d admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:41.864796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53b39-93d2-496e-9a8c-c8935b4a7d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:41.865069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53b39-93d2-496e-9a8c-c8935b4a7d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:41.865824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f53b39-93d2-496e-9a8c-c8935b4a7d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:41.867813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f53b39-93d2-496e-9a8c-c8935b4a7d2d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:41.901864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 975/1938] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:41 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:41.906102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12929a18-f22e-4087-8dae-532d43cb4f5f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:41.915822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12929a18-f22e-4087-8dae-532d43cb4f5f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:41.980491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c7409-f4b3-4f36-bf97-a331186f0d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:41.981174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7409-f4b3-4f36-bf97-a331186f0d94 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:41.981513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7409-f4b3-4f36-bf97-a331186f0d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:41.981789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7409-f4b3-4f36-bf97-a331186f0d94 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:41.982478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c7409-f4b3-4f36-bf97-a331186f0d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:41.984391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c7409-f4b3-4f36-bf97-a331186f0d94 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.009338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 964/1939] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:41 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:42.010962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f53b39-93d2-496e-9a8c-c8935b4a7d2d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.021539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f53b39-93d2-496e-9a8c-c8935b4a7d2d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.026374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82360-faa5-457d-93b2-6686db62ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.027055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82360-faa5-457d-93b2-6686db62ceba admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.027326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82360-faa5-457d-93b2-6686db62ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.027599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82360-faa5-457d-93b2-6686db62ceba admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.028365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82360-faa5-457d-93b2-6686db62ceba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.030014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82360-faa5-457d-93b2-6686db62ceba admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.040651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 976/1940] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:42.044769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c7409-f4b3-4f36-bf97-a331186f0d94 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.054844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c7409-f4b3-4f36-bf97-a331186f0d94 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.059709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6772b-e3b9-4dfc-bbec-914c4aed0604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.060375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6772b-e3b9-4dfc-bbec-914c4aed0604 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.060658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6772b-e3b9-4dfc-bbec-914c4aed0604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.060932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6772b-e3b9-4dfc-bbec-914c4aed0604 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.061730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6772b-e3b9-4dfc-bbec-914c4aed0604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.063368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6772b-e3b9-4dfc-bbec-914c4aed0604 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.073225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 965/1941] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:42.076963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82360-faa5-457d-93b2-6686db62ceba admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.087544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82360-faa5-457d-93b2-6686db62ceba admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.092232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a393e-315b-4664-a5f5-6586ed12bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.093127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a393e-315b-4664-a5f5-6586ed12bb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.093445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a393e-315b-4664-a5f5-6586ed12bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.093721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a393e-315b-4664-a5f5-6586ed12bb19 admin admin] PATH_INFO: `/v3/projects/24d7ea6f99714272b67ca7540a7b95e1/users/5643d50491824a6a8a62427630d97313/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.107821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a393e-315b-4664-a5f5-6586ed12bb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d7ea6f99714272b67ca7540a7b95e1, user_id=5643d50491824a6a8a62427630d97313, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.110500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a393e-315b-4664-a5f5-6586ed12bb19 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.126218 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 977/1942] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:42 2022] PUT /identity/v3/projects/24d7ea6f99714272b67ca7540a7b95e1/users/5643d50491824a6a8a62427630d97313/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:42.137030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463676f-ee89-42e0-b8d5-dd981a57e61d None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.137383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463676f-ee89-42e0-b8d5-dd981a57e61d None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.137665 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463676f-ee89-42e0-b8d5-dd981a57e61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.164524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7463676f-ee89-42e0-b8d5-dd981a57e61d None None] MFA Rules not processed for user `5643d50491824a6a8a62427630d97313`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:42.165782 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7463676f-ee89-42e0-b8d5-dd981a57e61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:42.232022 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 966/1943] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:42.236436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a393e-315b-4664-a5f5-6586ed12bb19 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.303236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a393e-315b-4664-a5f5-6586ed12bb19 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.308329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99627c-15be-430e-8e30-1534f17fca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.309045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99627c-15be-430e-8e30-1534f17fca07 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.309354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99627c-15be-430e-8e30-1534f17fca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.309666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99627c-15be-430e-8e30-1534f17fca07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.310371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99627c-15be-430e-8e30-1534f17fca07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.312225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99627c-15be-430e-8e30-1534f17fca07 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.342113 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 978/1944] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:42 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:42.343398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463676f-ee89-42e0-b8d5-dd981a57e61d None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.354597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463676f-ee89-42e0-b8d5-dd981a57e61d None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.411862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022208b7-43cb-4083-81c0-233012bffdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.412483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022208b7-43cb-4083-81c0-233012bffdab admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.412763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022208b7-43cb-4083-81c0-233012bffdab admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.417385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022208b7-43cb-4083-81c0-233012bffdab admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.418166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022208b7-43cb-4083-81c0-233012bffdab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.420111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022208b7-43cb-4083-81c0-233012bffdab admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.440552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 967/1945] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:42 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:42.444625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99627c-15be-430e-8e30-1534f17fca07 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.454959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99627c-15be-430e-8e30-1534f17fca07 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.460088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48c607-8e70-46c2-af69-ebd6f2d830b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.460760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48c607-8e70-46c2-af69-ebd6f2d830b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.461013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48c607-8e70-46c2-af69-ebd6f2d830b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.461314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48c607-8e70-46c2-af69-ebd6f2d830b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.462074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48c607-8e70-46c2-af69-ebd6f2d830b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.463740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48c607-8e70-46c2-af69-ebd6f2d830b4 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.474258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 979/1946] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:42.478284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022208b7-43cb-4083-81c0-233012bffdab admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.488816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022208b7-43cb-4083-81c0-233012bffdab admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.494437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9b03a-81dc-497f-ae84-af4d41a50648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.495432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9b03a-81dc-497f-ae84-af4d41a50648 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.495715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9b03a-81dc-497f-ae84-af4d41a50648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.495974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9b03a-81dc-497f-ae84-af4d41a50648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.496969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9b03a-81dc-497f-ae84-af4d41a50648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.498363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9b03a-81dc-497f-ae84-af4d41a50648 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.509209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 968/1947] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:42.513769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48c607-8e70-46c2-af69-ebd6f2d830b4 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.528688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48c607-8e70-46c2-af69-ebd6f2d830b4 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.533580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a77b9-5333-4ce5-951c-2effde801801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.534775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a77b9-5333-4ce5-951c-2effde801801 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.535320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a77b9-5333-4ce5-951c-2effde801801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.535599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a77b9-5333-4ce5-951c-2effde801801 admin admin] PATH_INFO: `/v3/projects/c5a15f60ee834d1b95083fae951465ac/users/d94dc91797584294b9a80fec7768da27/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.550118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a77b9-5333-4ce5-951c-2effde801801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a15f60ee834d1b95083fae951465ac, user_id=d94dc91797584294b9a80fec7768da27, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.552754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a77b9-5333-4ce5-951c-2effde801801 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.566193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 980/1948] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:42 2022] PUT /identity/v3/projects/c5a15f60ee834d1b95083fae951465ac/users/d94dc91797584294b9a80fec7768da27/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:42.577572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c777b-73c6-422b-973a-f972ac0a321b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.577846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c777b-73c6-422b-973a-f972ac0a321b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.578106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c777b-73c6-422b-973a-f972ac0a321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.605806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ac4c777b-73c6-422b-973a-f972ac0a321b None None] MFA Rules not processed for user `d94dc91797584294b9a80fec7768da27`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:42.607011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ac4c777b-73c6-422b-973a-f972ac0a321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:42.668505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 969/1949] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:42.673131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a77b9-5333-4ce5-951c-2effde801801 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.737197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a77b9-5333-4ce5-951c-2effde801801 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.741775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da615fc-93d6-43a6-a2b0-133315b09351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.742562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da615fc-93d6-43a6-a2b0-133315b09351 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.742847 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da615fc-93d6-43a6-a2b0-133315b09351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.743303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da615fc-93d6-43a6-a2b0-133315b09351 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.744007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da615fc-93d6-43a6-a2b0-133315b09351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.746334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da615fc-93d6-43a6-a2b0-133315b09351 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.772856 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 981/1950] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:42 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:42.776874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c777b-73c6-422b-973a-f972ac0a321b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.787445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c777b-73c6-422b-973a-f972ac0a321b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.842983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642f7cc-9624-416a-a14a-1c99892924c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.843751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642f7cc-9624-416a-a14a-1c99892924c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.844031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642f7cc-9624-416a-a14a-1c99892924c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.844370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642f7cc-9624-416a-a14a-1c99892924c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.845466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642f7cc-9624-416a-a14a-1c99892924c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.847822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642f7cc-9624-416a-a14a-1c99892924c1 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.869002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 970/1951] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:42 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:42.873769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da615fc-93d6-43a6-a2b0-133315b09351 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.884995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da615fc-93d6-43a6-a2b0-133315b09351 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.890614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fbe96-51fa-4409-9478-6fde67bac9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.891278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fbe96-51fa-4409-9478-6fde67bac9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.891540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fbe96-51fa-4409-9478-6fde67bac9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.891806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fbe96-51fa-4409-9478-6fde67bac9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.892545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fbe96-51fa-4409-9478-6fde67bac9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.894155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fbe96-51fa-4409-9478-6fde67bac9f7 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.905205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 982/1952] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:42.910861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642f7cc-9624-416a-a14a-1c99892924c1 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.921166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642f7cc-9624-416a-a14a-1c99892924c1 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:42.925939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a29cfd-172e-4811-91ba-bdc18165fc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:42.927539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a29cfd-172e-4811-91ba-bdc18165fc5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:42.927539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a29cfd-172e-4811-91ba-bdc18165fc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:42.927539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a29cfd-172e-4811-91ba-bdc18165fc5e admin admin] PATH_INFO: `/v3/projects/c60c3e1acd234bbdba452c726f84a552/users/f0c1610aac0547618e6387d60b96ff5e/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:42.950711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a29cfd-172e-4811-91ba-bdc18165fc5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60c3e1acd234bbdba452c726f84a552, user_id=f0c1610aac0547618e6387d60b96ff5e, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:42.953465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a29cfd-172e-4811-91ba-bdc18165fc5e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:42.968851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 971/1953] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:42 2022] PUT /identity/v3/projects/c60c3e1acd234bbdba452c726f84a552/users/f0c1610aac0547618e6387d60b96ff5e/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:42.972985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fbe96-51fa-4409-9478-6fde67bac9f7 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:42.982996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fbe96-51fa-4409-9478-6fde67bac9f7 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:43.043675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8db8d-97d7-485f-a421-b65633db2389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:43.044512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8db8d-97d7-485f-a421-b65633db2389 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:43.044595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8db8d-97d7-485f-a421-b65633db2389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:43.044875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8db8d-97d7-485f-a421-b65633db2389 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:43.045638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8db8d-97d7-485f-a421-b65633db2389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:43.047223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8db8d-97d7-485f-a421-b65633db2389 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:43.057238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 983/1954] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:43.061660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a29cfd-172e-4811-91ba-bdc18165fc5e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:43.072360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a29cfd-172e-4811-91ba-bdc18165fc5e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:43.077652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3de7e0-08e2-4dcd-997e-9e96eea62196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:43.078618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3de7e0-08e2-4dcd-997e-9e96eea62196 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:43.078968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3de7e0-08e2-4dcd-997e-9e96eea62196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:43.079310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3de7e0-08e2-4dcd-997e-9e96eea62196 admin admin] PATH_INFO: `/v3/projects/c60c3e1acd234bbdba452c726f84a552/users/f0c1610aac0547618e6387d60b96ff5e/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:43.081489 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3de7e0-08e2-4dcd-997e-9e96eea62196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60c3e1acd234bbdba452c726f84a552, user_id=f0c1610aac0547618e6387d60b96ff5e, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:43.084111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3de7e0-08e2-4dcd-997e-9e96eea62196 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:43.094655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 972/1955] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:43 2022] PUT /identity/v3/projects/c60c3e1acd234bbdba452c726f84a552/users/f0c1610aac0547618e6387d60b96ff5e/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:43.105041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b12bf-9afb-446f-8ee5-d858dc9968b4 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:43.105367 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b12bf-9afb-446f-8ee5-d858dc9968b4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:43.105631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b12bf-9afb-446f-8ee5-d858dc9968b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:43.133807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-dd1b12bf-9afb-446f-8ee5-d858dc9968b4 None None] MFA Rules not processed for user `f0c1610aac0547618e6387d60b96ff5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:43.135051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-dd1b12bf-9afb-446f-8ee5-d858dc9968b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:43.216204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 984/1956] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:43.227247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3de7e0-08e2-4dcd-997e-9e96eea62196 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:43.229181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8b3de7e0-08e2-4dcd-997e-9e96eea62196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:43.290178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3de7e0-08e2-4dcd-997e-9e96eea62196 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:43.294923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231251f-d7c0-4879-8983-712b16503eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:43.295617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231251f-d7c0-4879-8983-712b16503eaf service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:43.295896 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231251f-d7c0-4879-8983-712b16503eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:43.296169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231251f-d7c0-4879-8983-712b16503eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:43.306310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231251f-d7c0-4879-8983-712b16503eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:43.307789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231251f-d7c0-4879-8983-712b16503eaf service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:43.317709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 973/1957] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:43.854637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b12bf-9afb-446f-8ee5-d858dc9968b4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:43.856465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-dd1b12bf-9afb-446f-8ee5-d858dc9968b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:43.868581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b12bf-9afb-446f-8ee5-d858dc9968b4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:43.873492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a425d-d236-46bf-804e-5519503c85f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:43.874172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a425d-d236-46bf-804e-5519503c85f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:43.874432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a425d-d236-46bf-804e-5519503c85f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:43.874739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a425d-d236-46bf-804e-5519503c85f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:43.933778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a425d-d236-46bf-804e-5519503c85f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:43.935277 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a425d-d236-46bf-804e-5519503c85f7 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:43.945020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 985/1958] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:45.558566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231251f-d7c0-4879-8983-712b16503eaf service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:45.560081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c231251f-d7c0-4879-8983-712b16503eaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:45.627943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231251f-d7c0-4879-8983-712b16503eaf service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:45.634000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:45.634904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:45.635183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:45.635453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] PATH_INFO: `/v3/users/bfbb893a8ee846a481d5c108fdabbe25` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:45.636692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbb893a8ee846a481d5c108fdabbe25)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:45.638669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:45.705150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbb893a8ee846a481d5c108fdabbe25'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:45.715429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbb893a8ee846a481d5c108fdabbe25'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:45.716297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbb893a8ee846a481d5c108fdabbe25'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:45.717411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbb893a8ee846a481d5c108fdabbe25'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:45.727668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbb893a8ee846a481d5c108fdabbe25'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:45.746776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 974/1959] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:45 2022] DELETE /identity/v3/users/bfbb893a8ee846a481d5c108fdabbe25 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:45.751485 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985fa0d-0e54-4426-9d30-af93ecdd3e1d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:45.751938 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985fa0d-0e54-4426-9d30-af93ecdd3e1d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:45.752075 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985fa0d-0e54-4426-9d30-af93ecdd3e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:45.769933 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-0985fa0d-0e54-4426-9d30-af93ecdd3e1d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:45.771392 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0985fa0d-0e54-4426-9d30-af93ecdd3e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:45.859892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 986/1960] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:45.871161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:45.872816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:45.959740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51525ba9-3729-4d30-b8e2-4ed84ca75d0e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:45.963543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6921ba-de93-42b3-a2d8-1835b422eb48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:45.964212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6921ba-de93-42b3-a2d8-1835b422eb48 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:45.965141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6921ba-de93-42b3-a2d8-1835b422eb48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:45.965458 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6921ba-de93-42b3-a2d8-1835b422eb48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:45.975634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6921ba-de93-42b3-a2d8-1835b422eb48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:45.977106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6921ba-de93-42b3-a2d8-1835b422eb48 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:45.989879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 975/1961] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:46.366821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985fa0d-0e54-4426-9d30-af93ecdd3e1d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:46.368550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0985fa0d-0e54-4426-9d30-af93ecdd3e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:46.383944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985fa0d-0e54-4426-9d30-af93ecdd3e1d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:46.389228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:46.390197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:46.390793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:46.390793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] PATH_INFO: `/v3/projects/f0b03b527658452babb41bb302254a32` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:46.391962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b03b527658452babb41bb302254a32)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:46.393954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:46.484301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b03b527658452babb41bb302254a32', 'request_id': 'req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.496911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b03b527658452babb41bb302254a32', 'request_id': 'req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.505502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b03b527658452babb41bb302254a32', 'request_id': 'req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.516389 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] The token cache is being invalidate because project f0b03b527658452babb41bb302254a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:46.516674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.517461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.519386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 987/1962] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:46 2022] DELETE /identity/v3/projects/f0b03b527658452babb41bb302254a32 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:46.523103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6921ba-de93-42b3-a2d8-1835b422eb48 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:46.536312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6921ba-de93-42b3-a2d8-1835b422eb48 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:46.651259 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:46.652313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:46.652591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:46.652868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] PATH_INFO: `/v3/users/e5d0ad9784e942558a962f12215cf675` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:46.654618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d0ad9784e942558a962f12215cf675)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:46.656797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:46.761918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d0ad9784e942558a962f12215cf675'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.777493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d0ad9784e942558a962f12215cf675'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.780195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d0ad9784e942558a962f12215cf675'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.781560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d0ad9784e942558a962f12215cf675'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.800469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-464667ec-dfe0-49d6-a3fe-b8b4d820cd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d0ad9784e942558a962f12215cf675'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:46.839812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 976/1963] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:46 2022] DELETE /identity/v3/users/e5d0ad9784e942558a962f12215cf675 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:47.228199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:47.229947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:47.243264 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72efe5-835f-4461-bdd8-7c27e5cb3bdb admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:47.318270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:47.319316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.319687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.320330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] PATH_INFO: `/v3/projects/853695caa1304ee28f863ad1b853fd07` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.321671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] RBAC: Authorizing `identity:delete_project(project_id=853695caa1304ee28f863ad1b853fd07)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:47.323800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:47.374537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853695caa1304ee28f863ad1b853fd07', 'request_id': 'req-4f609916-5a9a-419c-a0c2-beb87fcc887a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:47.383925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853695caa1304ee28f863ad1b853fd07', 'request_id': 'req-4f609916-5a9a-419c-a0c2-beb87fcc887a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:47.390855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853695caa1304ee28f863ad1b853fd07', 'request_id': 'req-4f609916-5a9a-419c-a0c2-beb87fcc887a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:47.403432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] The token cache is being invalidate because project 853695caa1304ee28f863ad1b853fd07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:47.403843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:47.405952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-4f609916-5a9a-419c-a0c2-beb87fcc887a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:47.407558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 988/1964] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:47 2022] DELETE /identity/v3/projects/853695caa1304ee28f863ad1b853fd07 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:47.414166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ee227-670f-4174-ab25-124f020c2a03 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.414703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ee227-670f-4174-ab25-124f020c2a03 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.415209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ee227-670f-4174-ab25-124f020c2a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.445189 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d66ee227-670f-4174-ab25-124f020c2a03 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:47.446574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d66ee227-670f-4174-ab25-124f020c2a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:47.512297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 977/1965] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:47.520520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81938-6331-4358-9a8b-4a8e5c503492 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.520804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81938-6331-4358-9a8b-4a8e5c503492 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.521080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81938-6331-4358-9a8b-4a8e5c503492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.539347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-4ff81938-6331-4358-9a8b-4a8e5c503492 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:47.540558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4ff81938-6331-4358-9a8b-4a8e5c503492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:47.548439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 989/1966] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:47.552759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ee227-670f-4174-ab25-124f020c2a03 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:47.563432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ee227-670f-4174-ab25-124f020c2a03 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:47.567931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729920d2-b3f9-4592-bfad-143cdf2ff280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:47.568598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729920d2-b3f9-4592-bfad-143cdf2ff280 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.568875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729920d2-b3f9-4592-bfad-143cdf2ff280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.569143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729920d2-b3f9-4592-bfad-143cdf2ff280 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.569912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729920d2-b3f9-4592-bfad-143cdf2ff280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:47.570214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729920d2-b3f9-4592-bfad-143cdf2ff280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:47.571809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729920d2-b3f9-4592-bfad-143cdf2ff280 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:47.583230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 978/1967] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:47.589244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff81938-6331-4358-9a8b-4a8e5c503492 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:47.599025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff81938-6331-4358-9a8b-4a8e5c503492 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:47.605654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b5cb9-5973-4d92-bfa3-c5eb7e16ab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:47.606321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b5cb9-5973-4d92-bfa3-c5eb7e16ab83 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.606603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b5cb9-5973-4d92-bfa3-c5eb7e16ab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.606876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b5cb9-5973-4d92-bfa3-c5eb7e16ab83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.607606 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b5cb9-5973-4d92-bfa3-c5eb7e16ab83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:47.609609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b5cb9-5973-4d92-bfa3-c5eb7e16ab83 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:47.636784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 990/1968] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:47 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:47.642256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729920d2-b3f9-4592-bfad-143cdf2ff280 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:47.651942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729920d2-b3f9-4592-bfad-143cdf2ff280 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:47.708024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8c9c-d057-4b8f-bc00-944e27de553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:47.708704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8c9c-d057-4b8f-bc00-944e27de553a admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.708989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8c9c-d057-4b8f-bc00-944e27de553a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.709264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8c9c-d057-4b8f-bc00-944e27de553a admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.709983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8c9c-d057-4b8f-bc00-944e27de553a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:47.711922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8c9c-d057-4b8f-bc00-944e27de553a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:47.733693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 979/1969] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:47 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:47.738123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b5cb9-5973-4d92-bfa3-c5eb7e16ab83 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:47.750238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b5cb9-5973-4d92-bfa3-c5eb7e16ab83 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:47.756017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fac1-4fc4-4d33-af71-4314bad493e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:47.756764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fac1-4fc4-4d33-af71-4314bad493e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.757045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fac1-4fc4-4d33-af71-4314bad493e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.757348 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fac1-4fc4-4d33-af71-4314bad493e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.758107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54fac1-4fc4-4d33-af71-4314bad493e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:47.759790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54fac1-4fc4-4d33-af71-4314bad493e0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:47.770468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 991/1970] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:47.774607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8c9c-d057-4b8f-bc00-944e27de553a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:47.784670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8c9c-d057-4b8f-bc00-944e27de553a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:47.790488 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af6cf3-d238-43ce-a92b-c91a0ae14a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:47.791193 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af6cf3-d238-43ce-a92b-c91a0ae14a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.791515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af6cf3-d238-43ce-a92b-c91a0ae14a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.791783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af6cf3-d238-43ce-a92b-c91a0ae14a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.792507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af6cf3-d238-43ce-a92b-c91a0ae14a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:47.794144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af6cf3-d238-43ce-a92b-c91a0ae14a6b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:47.804336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 980/1971] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:57:47.808766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fac1-4fc4-4d33-af71-4314bad493e0 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:47.820526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fac1-4fc4-4d33-af71-4314bad493e0 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:47.827245 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60549eb7-62b4-49d5-a47a-c6a07fead33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:47.828204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549eb7-62b4-49d5-a47a-c6a07fead33e admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.828589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549eb7-62b4-49d5-a47a-c6a07fead33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.828892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549eb7-62b4-49d5-a47a-c6a07fead33e admin admin] PATH_INFO: `/v3/projects/41f1ef9bf4694b7fa292fbd6caaf9c28/users/07917c077f9b483da4db0e157f1357db/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.853336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60549eb7-62b4-49d5-a47a-c6a07fead33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f1ef9bf4694b7fa292fbd6caaf9c28, user_id=07917c077f9b483da4db0e157f1357db, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:47.856145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60549eb7-62b4-49d5-a47a-c6a07fead33e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:47.883667 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 992/1972] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:47 2022] PUT /identity/v3/projects/41f1ef9bf4694b7fa292fbd6caaf9c28/users/07917c077f9b483da4db0e157f1357db/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:47.895289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ae365-b301-4608-afe4-48daf32ea5da None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:47.895866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ae365-b301-4608-afe4-48daf32ea5da None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:47.896236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ae365-b301-4608-afe4-48daf32ea5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:47.938926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-b71ae365-b301-4608-afe4-48daf32ea5da None None] MFA Rules not processed for user `07917c077f9b483da4db0e157f1357db`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:47.949817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b71ae365-b301-4608-afe4-48daf32ea5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:48.026373 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 981/1973] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:48.037676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60549eb7-62b4-49d5-a47a-c6a07fead33e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:48.039419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-60549eb7-62b4-49d5-a47a-c6a07fead33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:48.110162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ae365-b301-4608-afe4-48daf32ea5da None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:48.112039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b71ae365-b301-4608-afe4-48daf32ea5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:48.118107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60549eb7-62b4-49d5-a47a-c6a07fead33e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:48.123558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5007c-1f28-4a7e-accb-53ef9a38ae25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63b338ae7e374ba5a7542c5a53deb416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:48.124613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5007c-1f28-4a7e-accb-53ef9a38ae25 service glance] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:48.124958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5007c-1f28-4a7e-accb-53ef9a38ae25 service glance] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:48.125330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5007c-1f28-4a7e-accb-53ef9a38ae25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:48.136613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5007c-1f28-4a7e-accb-53ef9a38ae25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:48.138156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5007c-1f28-4a7e-accb-53ef9a38ae25 service glance] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:48.155536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 993/1974] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:48.186943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ae365-b301-4608-afe4-48daf32ea5da None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:48.194296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993eb2-33dc-4935-bfc1-2f8803409595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:48.197923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993eb2-33dc-4935-bfc1-2f8803409595 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:48.198548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993eb2-33dc-4935-bfc1-2f8803409595 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:48.199033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993eb2-33dc-4935-bfc1-2f8803409595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:48.202581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-22993eb2-33dc-4935-bfc1-2f8803409595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:48.278599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22993eb2-33dc-4935-bfc1-2f8803409595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:48.280144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22993eb2-33dc-4935-bfc1-2f8803409595 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:48.289150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 982/1975] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:50.880405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5007c-1f28-4a7e-accb-53ef9a38ae25 service glance] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:50.881948 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-f6e5007c-1f28-4a7e-accb-53ef9a38ae25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:50.950273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5007c-1f28-4a7e-accb-53ef9a38ae25 service glance] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:50.955570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:50.956721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:50.957026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:50.957385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] PATH_INFO: `/v3/users/5643d50491824a6a8a62427630d97313` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:50.958675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5643d50491824a6a8a62427630d97313)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:50.960678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:51.008488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5643d50491824a6a8a62427630d97313'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.015135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5643d50491824a6a8a62427630d97313'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.015878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5643d50491824a6a8a62427630d97313'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.016535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5643d50491824a6a8a62427630d97313'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.025723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5643d50491824a6a8a62427630d97313'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.044938 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 994/1976] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:50 2022] DELETE /identity/v3/users/5643d50491824a6a8a62427630d97313 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:51.049710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a99520-f783-41d8-af2a-55fdb4181d77 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:51.050207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a99520-f783-41d8-af2a-55fdb4181d77 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:51.050296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a99520-f783-41d8-af2a-55fdb4181d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:51.068395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-46a99520-f783-41d8-af2a-55fdb4181d77 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:51.069642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-46a99520-f783-41d8-af2a-55fdb4181d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:51.129530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 983/1977] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:51.139882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:51.141778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:51.197878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4ac1b-1ff0-48b2-8aed-ee0e379cf090 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:51.202036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f25d5-2000-49d8-90f3-71c24ddd3ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:51.202682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f25d5-2000-49d8-90f3-71c24ddd3ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:51.202964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f25d5-2000-49d8-90f3-71c24ddd3ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:51.203232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f25d5-2000-49d8-90f3-71c24ddd3ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:51.212514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f25d5-2000-49d8-90f3-71c24ddd3ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:51.213997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f25d5-2000-49d8-90f3-71c24ddd3ab7 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:51.223882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 995/1978] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:51.526429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a99520-f783-41d8-af2a-55fdb4181d77 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:51.528749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-46a99520-f783-41d8-af2a-55fdb4181d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:51.573307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a99520-f783-41d8-af2a-55fdb4181d77 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:51.580626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:51.582463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:51.583059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:51.583630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] PATH_INFO: `/v3/projects/24d7ea6f99714272b67ca7540a7b95e1` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:51.586064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d7ea6f99714272b67ca7540a7b95e1)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:51.589907 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:51.720821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d7ea6f99714272b67ca7540a7b95e1', 'request_id': 'req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.733111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d7ea6f99714272b67ca7540a7b95e1', 'request_id': 'req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.751516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d7ea6f99714272b67ca7540a7b95e1', 'request_id': 'req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.766647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] The token cache is being invalidate because project 24d7ea6f99714272b67ca7540a7b95e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:51.766944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.768258 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.770856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 984/1979] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:51 2022] DELETE /identity/v3/projects/24d7ea6f99714272b67ca7540a7b95e1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:51.774902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f25d5-2000-49d8-90f3-71c24ddd3ab7 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:51.786383 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f25d5-2000-49d8-90f3-71c24ddd3ab7 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:51.862910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:51.864124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:51.864286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:51.864728 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] PATH_INFO: `/v3/users/d94dc91797584294b9a80fec7768da27` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:51.866120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94dc91797584294b9a80fec7768da27)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:51.870335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:51.953501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94dc91797584294b9a80fec7768da27'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.962897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94dc91797584294b9a80fec7768da27'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.965883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94dc91797584294b9a80fec7768da27'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.966793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94dc91797584294b9a80fec7768da27'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:51.984302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94dc91797584294b9a80fec7768da27'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.027571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 996/1980] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:51 2022] DELETE /identity/v3/users/d94dc91797584294b9a80fec7768da27 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:52.434754 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:52.436806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:52.457481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8bf8f-9dd4-4c0b-bf2b-7fcc2627019f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:52.530975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:52.531892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:52.532171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:52.532571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] PATH_INFO: `/v3/projects/c5a15f60ee834d1b95083fae951465ac` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:52.533817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a15f60ee834d1b95083fae951465ac)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:52.535721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:52.583924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a15f60ee834d1b95083fae951465ac', 'request_id': 'req-00e44a30-6404-4d74-9f3e-44199afe28a3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.591407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a15f60ee834d1b95083fae951465ac', 'request_id': 'req-00e44a30-6404-4d74-9f3e-44199afe28a3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.600414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a15f60ee834d1b95083fae951465ac', 'request_id': 'req-00e44a30-6404-4d74-9f3e-44199afe28a3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.611114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] The token cache is being invalidate because project c5a15f60ee834d1b95083fae951465ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:52.611404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.612026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.613886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 985/1981] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:52 2022] DELETE /identity/v3/projects/c5a15f60ee834d1b95083fae951465ac => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:52.617992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:52.619924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:52.632664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f6374-5f62-49b2-beed-87add02c6158 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:52.690523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:52.691444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:52.691709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:52.691993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] PATH_INFO: `/v3/users/f0c1610aac0547618e6387d60b96ff5e` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:52.693262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c1610aac0547618e6387d60b96ff5e)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:52.695249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:52.747591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c1610aac0547618e6387d60b96ff5e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.756093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c1610aac0547618e6387d60b96ff5e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.757030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c1610aac0547618e6387d60b96ff5e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.757787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c1610aac0547618e6387d60b96ff5e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.768694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-165f4cc8-207a-4a51-8238-f85046d910e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c1610aac0547618e6387d60b96ff5e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:52.787355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 997/1982] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:52 2022] DELETE /identity/v3/users/f0c1610aac0547618e6387d60b96ff5e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:53.104970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:53.108828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:53.120136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e44a30-6404-4d74-9f3e-44199afe28a3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:53.182558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:53.183659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.183943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.184219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] PATH_INFO: `/v3/projects/c60c3e1acd234bbdba452c726f84a552` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.185572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60c3e1acd234bbdba452c726f84a552)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:53.187553 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:53.235198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60c3e1acd234bbdba452c726f84a552', 'request_id': 'req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:53.241098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60c3e1acd234bbdba452c726f84a552', 'request_id': 'req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:53.250329 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60c3e1acd234bbdba452c726f84a552', 'request_id': 'req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:53.260515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] The token cache is being invalidate because project c60c3e1acd234bbdba452c726f84a552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:53.260796 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:53.261433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-26ae19a3-2b7f-4cbd-be26-61bd23d782ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:53.262995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 986/1983] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:53 2022] DELETE /identity/v3/projects/c60c3e1acd234bbdba452c726f84a552 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:53.268925 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856a89-8431-45cc-a7da-a46dfb6cf582 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.269512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856a89-8431-45cc-a7da-a46dfb6cf582 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.269512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856a89-8431-45cc-a7da-a46dfb6cf582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.287786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-17856a89-8431-45cc-a7da-a46dfb6cf582 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:53.288980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-17856a89-8431-45cc-a7da-a46dfb6cf582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:53.346070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 998/1984] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:53.355638 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396b977-6ea3-41b7-b854-de5f2c60b9a9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.356002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396b977-6ea3-41b7-b854-de5f2c60b9a9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.356403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396b977-6ea3-41b7-b854-de5f2c60b9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.376346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c396b977-6ea3-41b7-b854-de5f2c60b9a9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:53.377644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c396b977-6ea3-41b7-b854-de5f2c60b9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:53.397055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 987/1985] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:53.398712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17856a89-8431-45cc-a7da-a46dfb6cf582 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:53.410359 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17856a89-8431-45cc-a7da-a46dfb6cf582 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:53.419360 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d14f5-a202-48d8-9d47-b5a1c96a0a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:53.420108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d14f5-a202-48d8-9d47-b5a1c96a0a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.420404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d14f5-a202-48d8-9d47-b5a1c96a0a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.420732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d14f5-a202-48d8-9d47-b5a1c96a0a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.421550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d14f5-a202-48d8-9d47-b5a1c96a0a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:53.421868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d14f5-a202-48d8-9d47-b5a1c96a0a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:53.423659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d14f5-a202-48d8-9d47-b5a1c96a0a4e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:53.436189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 999/1986] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:53.448567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396b977-6ea3-41b7-b854-de5f2c60b9a9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:53.458718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396b977-6ea3-41b7-b854-de5f2c60b9a9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:53.463318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b1214-70a1-49ac-84f0-bc43651f852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:53.464002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b1214-70a1-49ac-84f0-bc43651f852c admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.464343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b1214-70a1-49ac-84f0-bc43651f852c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.464621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b1214-70a1-49ac-84f0-bc43651f852c admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.465354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b1214-70a1-49ac-84f0-bc43651f852c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:53.467272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b1214-70a1-49ac-84f0-bc43651f852c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:53.494872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 988/1987] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:53 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:53.499178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d14f5-a202-48d8-9d47-b5a1c96a0a4e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:53.509382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d14f5-a202-48d8-9d47-b5a1c96a0a4e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:53.569848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b2695-9ec0-4511-9735-d7b30a938b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:53.570518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b2695-9ec0-4511-9735-d7b30a938b5e admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.570804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b2695-9ec0-4511-9735-d7b30a938b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.571070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b2695-9ec0-4511-9735-d7b30a938b5e admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.571797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b2695-9ec0-4511-9735-d7b30a938b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:53.573850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b2695-9ec0-4511-9735-d7b30a938b5e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:53.603804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1000/1988] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:53 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:57:53.607686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b1214-70a1-49ac-84f0-bc43651f852c admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:53.623381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b1214-70a1-49ac-84f0-bc43651f852c admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:53.644580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a3e9b-5226-436f-9d56-7a22cc6b174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:53.646230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a3e9b-5226-436f-9d56-7a22cc6b174d admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.646511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a3e9b-5226-436f-9d56-7a22cc6b174d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.646948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a3e9b-5226-436f-9d56-7a22cc6b174d admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.647837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a3e9b-5226-436f-9d56-7a22cc6b174d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:53.650464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a3e9b-5226-436f-9d56-7a22cc6b174d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:53.665600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 989/1989] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:53.670424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b2695-9ec0-4511-9735-d7b30a938b5e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:53.684734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b2695-9ec0-4511-9735-d7b30a938b5e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:53.689664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752cb55-db13-4ee8-9bb0-940e31432f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:53.690804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752cb55-db13-4ee8-9bb0-940e31432f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.690804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752cb55-db13-4ee8-9bb0-940e31432f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.691008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752cb55-db13-4ee8-9bb0-940e31432f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.691619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752cb55-db13-4ee8-9bb0-940e31432f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:53.693404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752cb55-db13-4ee8-9bb0-940e31432f43 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:53.706876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1001/1990] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:53.711253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a3e9b-5226-436f-9d56-7a22cc6b174d admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:53.722096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a3e9b-5226-436f-9d56-7a22cc6b174d admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:53.734241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ea1f-d409-4e04-af53-af3b03fbc8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:53.735253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ea1f-d409-4e04-af53-af3b03fbc8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.735609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ea1f-d409-4e04-af53-af3b03fbc8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.735947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ea1f-d409-4e04-af53-af3b03fbc8ac admin admin] PATH_INFO: `/v3/projects/361adb4a38a64be09d6e54faad3d836c/users/de2b4acb5c4d405e878de18da3e5f2b8/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.751468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516ea1f-d409-4e04-af53-af3b03fbc8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=361adb4a38a64be09d6e54faad3d836c, user_id=de2b4acb5c4d405e878de18da3e5f2b8, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:53.754288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516ea1f-d409-4e04-af53-af3b03fbc8ac admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:53.770296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 990/1991] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:53 2022] PUT /identity/v3/projects/361adb4a38a64be09d6e54faad3d836c/users/de2b4acb5c4d405e878de18da3e5f2b8/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:53.783583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0510a-46af-4721-b28a-87ab830aa49a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.783892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0510a-46af-4721-b28a-87ab830aa49a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.784188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0510a-46af-4721-b28a-87ab830aa49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.810552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5aa0510a-46af-4721-b28a-87ab830aa49a None None] MFA Rules not processed for user `de2b4acb5c4d405e878de18da3e5f2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:53.811845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5aa0510a-46af-4721-b28a-87ab830aa49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:53.878602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1002/1992] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:53.883411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ea1f-d409-4e04-af53-af3b03fbc8ac admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:53.948228 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ea1f-d409-4e04-af53-af3b03fbc8ac admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:53.953260 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7605a-1e83-4ba7-8124-2f7dc7250736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:53.953989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7605a-1e83-4ba7-8124-2f7dc7250736 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:53.954282 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7605a-1e83-4ba7-8124-2f7dc7250736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:53.954689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7605a-1e83-4ba7-8124-2f7dc7250736 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:53.955416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7605a-1e83-4ba7-8124-2f7dc7250736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:53.957337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7605a-1e83-4ba7-8124-2f7dc7250736 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:53.988976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 991/1993] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:53 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:57:53.993259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0510a-46af-4721-b28a-87ab830aa49a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:54.007462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0510a-46af-4721-b28a-87ab830aa49a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:54.081748 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a1b74-2da3-4261-a739-9114e8632f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:54.082682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a1b74-2da3-4261-a739-9114e8632f42 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.083090 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a1b74-2da3-4261-a739-9114e8632f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.083479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a1b74-2da3-4261-a739-9114e8632f42 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.084332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a1b74-2da3-4261-a739-9114e8632f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:54.086429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a1b74-2da3-4261-a739-9114e8632f42 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:54.108144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1003/1994] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:57:53 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:57:54.112372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7605a-1e83-4ba7-8124-2f7dc7250736 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:54.125068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7605a-1e83-4ba7-8124-2f7dc7250736 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:54.129871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a463df-55e2-49bb-9cd5-036f52f21519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:54.130570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a463df-55e2-49bb-9cd5-036f52f21519 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.130907 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a463df-55e2-49bb-9cd5-036f52f21519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.131336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a463df-55e2-49bb-9cd5-036f52f21519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.132057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a463df-55e2-49bb-9cd5-036f52f21519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:54.133780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a463df-55e2-49bb-9cd5-036f52f21519 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:54.145691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 992/1995] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:54.150004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a1b74-2da3-4261-a739-9114e8632f42 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:54.159817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a1b74-2da3-4261-a739-9114e8632f42 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:54.164927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1f6e0-64dd-4bf4-8d04-dd8d9f255f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:54.165842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f6e0-64dd-4bf4-8d04-dd8d9f255f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.166141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f6e0-64dd-4bf4-8d04-dd8d9f255f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.166415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f6e0-64dd-4bf4-8d04-dd8d9f255f4d admin admin] PATH_INFO: `/v3/projects/e98816728b2b44cf90bd5ff419dc25b5/users/5fa160de22fa4e049a2248831db51775/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.182652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1f6e0-64dd-4bf4-8d04-dd8d9f255f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98816728b2b44cf90bd5ff419dc25b5, user_id=5fa160de22fa4e049a2248831db51775, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:54.185364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1f6e0-64dd-4bf4-8d04-dd8d9f255f4d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:54.198233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1004/1996] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:54 2022] PUT /identity/v3/projects/e98816728b2b44cf90bd5ff419dc25b5/users/5fa160de22fa4e049a2248831db51775/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:54.202407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a463df-55e2-49bb-9cd5-036f52f21519 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:54.212612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a463df-55e2-49bb-9cd5-036f52f21519 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:54.279840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b4ff4-7af1-4de2-9341-8421f5e44630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:54.280526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b4ff4-7af1-4de2-9341-8421f5e44630 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.280804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b4ff4-7af1-4de2-9341-8421f5e44630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.281328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b4ff4-7af1-4de2-9341-8421f5e44630 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.282054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b4ff4-7af1-4de2-9341-8421f5e44630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:54.286235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b4ff4-7af1-4de2-9341-8421f5e44630 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:54.297787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 993/1997] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:57:54.301833 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1f6e0-64dd-4bf4-8d04-dd8d9f255f4d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:54.314195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1f6e0-64dd-4bf4-8d04-dd8d9f255f4d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:54.327551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e1da6-ad55-4898-bad8-e0ebbfdf236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:54.328527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e1da6-ad55-4898-bad8-e0ebbfdf236c admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.328830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e1da6-ad55-4898-bad8-e0ebbfdf236c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.329089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e1da6-ad55-4898-bad8-e0ebbfdf236c admin admin] PATH_INFO: `/v3/projects/e98816728b2b44cf90bd5ff419dc25b5/users/5fa160de22fa4e049a2248831db51775/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.331148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e1da6-ad55-4898-bad8-e0ebbfdf236c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98816728b2b44cf90bd5ff419dc25b5, user_id=5fa160de22fa4e049a2248831db51775, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:54.333963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e1da6-ad55-4898-bad8-e0ebbfdf236c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:54.344651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1005/1998] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:57:54 2022] PUT /identity/v3/projects/e98816728b2b44cf90bd5ff419dc25b5/users/5fa160de22fa4e049a2248831db51775/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:54.356375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87d52-783a-4e42-a5fd-6757ba8add6a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.356705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87d52-783a-4e42-a5fd-6757ba8add6a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.356976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87d52-783a-4e42-a5fd-6757ba8add6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.383336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9ab87d52-783a-4e42-a5fd-6757ba8add6a None None] MFA Rules not processed for user `5fa160de22fa4e049a2248831db51775`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:54.384469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9ab87d52-783a-4e42-a5fd-6757ba8add6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:54.458632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 994/1999] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:54.469744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e1da6-ad55-4898-bad8-e0ebbfdf236c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:54.471835 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-aa7e1da6-ad55-4898-bad8-e0ebbfdf236c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:54.530384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e1da6-ad55-4898-bad8-e0ebbfdf236c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:54.534103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991a6de-5be2-42ee-9862-96eb97125ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:54.534755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991a6de-5be2-42ee-9862-96eb97125ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.535030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991a6de-5be2-42ee-9862-96eb97125ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.535299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991a6de-5be2-42ee-9862-96eb97125ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.545102 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991a6de-5be2-42ee-9862-96eb97125ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:54.546613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991a6de-5be2-42ee-9862-96eb97125ef7 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:54.557696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1006/2000] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:54.607275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87d52-783a-4e42-a5fd-6757ba8add6a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:54.608846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9ab87d52-783a-4e42-a5fd-6757ba8add6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:54.621607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87d52-783a-4e42-a5fd-6757ba8add6a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:54.625392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568bc2e-b68d-43eb-86e0-d68cbb41b819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:54.626080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568bc2e-b68d-43eb-86e0-d68cbb41b819 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:54.626363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568bc2e-b68d-43eb-86e0-d68cbb41b819 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:54.626635 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568bc2e-b68d-43eb-86e0-d68cbb41b819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:54.682416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568bc2e-b68d-43eb-86e0-d68cbb41b819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:54.683803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568bc2e-b68d-43eb-86e0-d68cbb41b819 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:54.692549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 995/2001] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:58.282009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991a6de-5be2-42ee-9862-96eb97125ef7 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:58.359945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991a6de-5be2-42ee-9862-96eb97125ef7 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:58.366411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:58.367403 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:58.367684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:58.368140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] PATH_INFO: `/v3/users/de2b4acb5c4d405e878de18da3e5f2b8` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:58.369855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2b4acb5c4d405e878de18da3e5f2b8)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:58.371825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:58.429857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2b4acb5c4d405e878de18da3e5f2b8'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.437426 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2b4acb5c4d405e878de18da3e5f2b8'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.438332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2b4acb5c4d405e878de18da3e5f2b8'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.439098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2b4acb5c4d405e878de18da3e5f2b8'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.450995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568bc2e-b68d-43eb-86e0-d68cbb41b819 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:58.452445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2568bc2e-b68d-43eb-86e0-d68cbb41b819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:58.459170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c56ff7e6-b625-468a-81d7-880737f9d457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2b4acb5c4d405e878de18da3e5f2b8'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.467271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568bc2e-b68d-43eb-86e0-d68cbb41b819 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:58.476844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:58.479529 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:58.479967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:58.480572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] PATH_INFO: `/v3/users/2a1afcef95de46cbb4d9456b3224ef36` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:58.482070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1afcef95de46cbb4d9456b3224ef36)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:58.484054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1007/2002] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:58 2022] DELETE /identity/v3/users/de2b4acb5c4d405e878de18da3e5f2b8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:58.484339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:58.488534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305a3df-5a84-499e-a142-efd2e4eda97a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:58.488808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305a3df-5a84-499e-a142-efd2e4eda97a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:58.489159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305a3df-5a84-499e-a142-efd2e4eda97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:58.507120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-1305a3df-5a84-499e-a142-efd2e4eda97a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:58.508422 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1305a3df-5a84-499e-a142-efd2e4eda97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:58.547716 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1afcef95de46cbb4d9456b3224ef36'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.555349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1afcef95de46cbb4d9456b3224ef36'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.556173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1afcef95de46cbb4d9456b3224ef36'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.556886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1afcef95de46cbb4d9456b3224ef36'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.565619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1afcef95de46cbb4d9456b3224ef36'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.583476 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 996/2003] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:58 2022] DELETE /identity/v3/users/2a1afcef95de46cbb4d9456b3224ef36 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:58.596694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1008/2004] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:57:58.609647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:58.611542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:58.681761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64735-834a-49f5-a167-63b91645a5d6 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:58.684792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62037eb-aaf2-4713-8b59-ff76051e63aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:58.685703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62037eb-aaf2-4713-8b59-ff76051e63aa service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:58.686044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62037eb-aaf2-4713-8b59-ff76051e63aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:58.686385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62037eb-aaf2-4713-8b59-ff76051e63aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:58.691496 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305a3df-5a84-499e-a142-efd2e4eda97a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:58.693598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1305a3df-5a84-499e-a142-efd2e4eda97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:58.712739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305a3df-5a84-499e-a142-efd2e4eda97a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:58.777440 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62037eb-aaf2-4713-8b59-ff76051e63aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:58.779682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62037eb-aaf2-4713-8b59-ff76051e63aa service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:58.794588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 997/2005] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:57:58.797303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:58.798646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:58.798936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:58.799215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] PATH_INFO: `/v3/users/66b7e19a875c48069bec426b1b2efa7c` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:58.799775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62037eb-aaf2-4713-8b59-ff76051e63aa service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:58.800779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b7e19a875c48069bec426b1b2efa7c)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:58.801496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d62037eb-aaf2-4713-8b59-ff76051e63aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:58.802846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:58.814574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62037eb-aaf2-4713-8b59-ff76051e63aa service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:58.823916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:58.825160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:58.825654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:58.826066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] PATH_INFO: `/v3/projects/6246e8e0efa54df99200eb2281778272` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:58.827473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6246e8e0efa54df99200eb2281778272)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:58.831511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:58.872906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b7e19a875c48069bec426b1b2efa7c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.882498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b7e19a875c48069bec426b1b2efa7c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.883506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b7e19a875c48069bec426b1b2efa7c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.884498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b7e19a875c48069bec426b1b2efa7c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.889408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6246e8e0efa54df99200eb2281778272', 'request_id': 'req-6a4f4376-52bf-41c1-b714-6e735229bf4e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.893465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b7e19a875c48069bec426b1b2efa7c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.896868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6246e8e0efa54df99200eb2281778272', 'request_id': 'req-6a4f4376-52bf-41c1-b714-6e735229bf4e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.904640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6246e8e0efa54df99200eb2281778272', 'request_id': 'req-6a4f4376-52bf-41c1-b714-6e735229bf4e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.914479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1009/2006] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:58 2022] DELETE /identity/v3/users/66b7e19a875c48069bec426b1b2efa7c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:58.918750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] The token cache is being invalidate because project 6246e8e0efa54df99200eb2281778272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:58.919026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.919700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:58.921571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 998/2007] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:58 2022] DELETE /identity/v3/projects/6246e8e0efa54df99200eb2281778272 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:58.925215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:58.926662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.004943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ef1f-c16d-4596-9f1c-4e9ff8331f37 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:59.009745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:59.010629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.010901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.011172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] PATH_INFO: `/v3/users/40003c1f9922454eaa80dd5f114f7c70` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.012436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=40003c1f9922454eaa80dd5f114f7c70)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:59.014425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:59.085408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40003c1f9922454eaa80dd5f114f7c70'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.090189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40003c1f9922454eaa80dd5f114f7c70'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.090946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40003c1f9922454eaa80dd5f114f7c70'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.091641 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40003c1f9922454eaa80dd5f114f7c70'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.100758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40003c1f9922454eaa80dd5f114f7c70'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.124097 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1010/2008] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:58 2022] DELETE /identity/v3/users/40003c1f9922454eaa80dd5f114f7c70 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:59.201948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:59.203568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.210969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:59.213183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.303126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05e348-9162-40d3-a342-6a5d5b3887ca admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:59.309739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:59.310868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.311281 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.311695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] PATH_INFO: `/v3/projects/625af698d5ee489d92da3d75516477cb` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.313552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=625af698d5ee489d92da3d75516477cb)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:59.315949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:59.334534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f4376-52bf-41c1-b714-6e735229bf4e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:59.340410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:59.341327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.341619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.341886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] PATH_INFO: `/v3/projects/361adb4a38a64be09d6e54faad3d836c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.343143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361adb4a38a64be09d6e54faad3d836c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:59.345048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:59.379799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625af698d5ee489d92da3d75516477cb', 'request_id': 'req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.392225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625af698d5ee489d92da3d75516477cb', 'request_id': 'req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.403570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625af698d5ee489d92da3d75516477cb', 'request_id': 'req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.422241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] The token cache is being invalidate because project 625af698d5ee489d92da3d75516477cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:59.422532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.423200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.425823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1011/2009] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:59 2022] DELETE /identity/v3/projects/625af698d5ee489d92da3d75516477cb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:57:59.429208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:59.429208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.435820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361adb4a38a64be09d6e54faad3d836c', 'request_id': 'req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.442064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361adb4a38a64be09d6e54faad3d836c', 'request_id': 'req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.453970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361adb4a38a64be09d6e54faad3d836c', 'request_id': 'req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.464869 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] The token cache is being invalidate because project 361adb4a38a64be09d6e54faad3d836c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:59.465833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.466671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8233590f-5e32-4a8a-b8dc-d8dbe7918ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.468548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 999/2010] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:59 2022] DELETE /identity/v3/projects/361adb4a38a64be09d6e54faad3d836c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:59.473786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec7eb-b45b-46e1-9ca7-ee82f2a368a2 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.474232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec7eb-b45b-46e1-9ca7-ee82f2a368a2 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.475171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec7eb-b45b-46e1-9ca7-ee82f2a368a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.498479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ca7ec7eb-b45b-46e1-9ca7-ee82f2a368a2 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:59.499941 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ca7ec7eb-b45b-46e1-9ca7-ee82f2a368a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.511095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e323c-fc8e-4ed2-9425-e4ebee45a17b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:59.572725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:59.573673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.573957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.574255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] PATH_INFO: `/v3/projects/db57282f1eba43f1a016db9a3981dc9d` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.575434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db57282f1eba43f1a016db9a3981dc9d)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:59.577378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:59.578389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1000/2011] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:59.579233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ec7eb-b45b-46e1-9ca7-ee82f2a368a2 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:59.582405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ca7ec7eb-b45b-46e1-9ca7-ee82f2a368a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.593966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ec7eb-b45b-46e1-9ca7-ee82f2a368a2 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:59.598714 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:59.599690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.600071 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.600439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] PATH_INFO: `/v3/users/5fa160de22fa4e049a2248831db51775` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.601790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa160de22fa4e049a2248831db51775)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:59.604044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:59.624732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db57282f1eba43f1a016db9a3981dc9d', 'request_id': 'req-f3b2048a-cd1f-49c7-9c77-aed088adb72a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.634920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db57282f1eba43f1a016db9a3981dc9d', 'request_id': 'req-f3b2048a-cd1f-49c7-9c77-aed088adb72a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.641266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db57282f1eba43f1a016db9a3981dc9d', 'request_id': 'req-f3b2048a-cd1f-49c7-9c77-aed088adb72a'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.651318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] The token cache is being invalidate because project db57282f1eba43f1a016db9a3981dc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:57:59.651611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.651777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa160de22fa4e049a2248831db51775'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.652260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.653875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1012/2012] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:57:59 2022] DELETE /identity/v3/projects/db57282f1eba43f1a016db9a3981dc9d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:59.657210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:59.658112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.663434 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa160de22fa4e049a2248831db51775'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.664263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa160de22fa4e049a2248831db51775'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.665072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa160de22fa4e049a2248831db51775'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.674252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f713c226-baea-4c08-a411-1eeb3a623881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa160de22fa4e049a2248831db51775'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.695049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1001/2013] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:59 2022] DELETE /identity/v3/users/5fa160de22fa4e049a2248831db51775 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:59.696369 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f962a7-288f-4f90-922c-02a8d3e842dc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.696651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f962a7-288f-4f90-922c-02a8d3e842dc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.696926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f962a7-288f-4f90-922c-02a8d3e842dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.715982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d7f962a7-288f-4f90-922c-02a8d3e842dc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:59.717302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d7f962a7-288f-4f90-922c-02a8d3e842dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.726450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2048a-cd1f-49c7-9c77-aed088adb72a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:59.782317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1002/2014] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:59.784016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e129557-e4d5-48cd-bc5e-c4a5b493f605 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.784485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e129557-e4d5-48cd-bc5e-c4a5b493f605 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.784979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e129557-e4d5-48cd-bc5e-c4a5b493f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.805946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-6e129557-e4d5-48cd-bc5e-c4a5b493f605 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:59.808476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:59.810485 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.810891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6e129557-e4d5-48cd-bc5e-c4a5b493f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.811195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.811651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] PATH_INFO: `/v3/users/b6211a5ec32b467887e786f62881c9ee` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.813384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6211a5ec32b467887e786f62881c9ee)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:59.816112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:59.823040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1003/2015] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:59.834049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e129557-e4d5-48cd-bc5e-c4a5b493f605 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:59.846874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e129557-e4d5-48cd-bc5e-c4a5b493f605 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:59.855016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cf175-b1d2-4590-a8da-331886da2438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:59.855831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf175-b1d2-4590-a8da-331886da2438 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.856312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf175-b1d2-4590-a8da-331886da2438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.856656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf175-b1d2-4590-a8da-331886da2438 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.857988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cf175-b1d2-4590-a8da-331886da2438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:57:59.858408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cf175-b1d2-4590-a8da-331886da2438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:59.860971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cf175-b1d2-4590-a8da-331886da2438 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:57:59.876377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1004/2016] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:57:59.878604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc50f7-e779-4f86-9c0a-ca80ca4a4b83 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.878967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc50f7-e779-4f86-9c0a-ca80ca4a4b83 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.879307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc50f7-e779-4f86-9c0a-ca80ca4a4b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.888534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6211a5ec32b467887e786f62881c9ee'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.896850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6211a5ec32b467887e786f62881c9ee'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.897728 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6211a5ec32b467887e786f62881c9ee'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.898549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6211a5ec32b467887e786f62881c9ee'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.903764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-65cc50f7-e779-4f86-9c0a-ca80ca4a4b83 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:57:59.905024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-65cc50f7-e779-4f86-9c0a-ca80ca4a4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.909053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6211a5ec32b467887e786f62881c9ee'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:57:59.914645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1005/2017] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:57:59.914645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc50f7-e779-4f86-9c0a-ca80ca4a4b83 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:59.917688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-65cc50f7-e779-4f86-9c0a-ca80ca4a4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:57:59.929507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc50f7-e779-4f86-9c0a-ca80ca4a4b83 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:57:59.934125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1013/2018] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:57:59 2022] DELETE /identity/v3/users/b6211a5ec32b467887e786f62881c9ee => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:57:59.935164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:57:59.937981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30112d9-af6e-4b97-b971-a09563fa3e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:57:59.938744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30112d9-af6e-4b97-b971-a09563fa3e3f admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:57:59.939461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30112d9-af6e-4b97-b971-a09563fa3e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:57:59.948561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30112d9-af6e-4b97-b971-a09563fa3e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:57:59.949652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30112d9-af6e-4b97-b971-a09563fa3e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:57:59.951801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30112d9-af6e-4b97-b971-a09563fa3e3f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.003764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89048-6bc7-48b3-9afe-e818bed510a4 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.016008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1006/2019] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:57:59 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:00.016008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f7911-893a-46b6-a65e-ca1989940fbc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.016008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f7911-893a-46b6-a65e-ca1989940fbc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.016008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f7911-893a-46b6-a65e-ca1989940fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.048315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-691f7911-893a-46b6-a65e-ca1989940fbc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:00.049644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-691f7911-893a-46b6-a65e-ca1989940fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.071792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15b5cd-1bf4-4f79-95d0-dc48d1486a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.072595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15b5cd-1bf4-4f79-95d0-dc48d1486a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.072880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15b5cd-1bf4-4f79-95d0-dc48d1486a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.073157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15b5cd-1bf4-4f79-95d0-dc48d1486a56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.074067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15b5cd-1bf4-4f79-95d0-dc48d1486a56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:00.074380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15b5cd-1bf4-4f79-95d0-dc48d1486a56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.075988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15b5cd-1bf4-4f79-95d0-dc48d1486a56 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.091198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1014/2020] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:58:00.091198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15b5cd-1bf4-4f79-95d0-dc48d1486a56 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.099444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15b5cd-1bf4-4f79-95d0-dc48d1486a56 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.107659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ea07-17e8-4c9d-81f8-2fc7350bdeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.108669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ea07-17e8-4c9d-81f8-2fc7350bdeae admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.109042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ea07-17e8-4c9d-81f8-2fc7350bdeae admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.109476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ea07-17e8-4c9d-81f8-2fc7350bdeae admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.110412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74ea07-17e8-4c9d-81f8-2fc7350bdeae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.112570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74ea07-17e8-4c9d-81f8-2fc7350bdeae admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.122690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1007/2021] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:00.123937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f7911-893a-46b6-a65e-ca1989940fbc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.125906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-691f7911-893a-46b6-a65e-ca1989940fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.139552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1015/2022] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:00.139734 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f7911-893a-46b6-a65e-ca1989940fbc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.140223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ea07-17e8-4c9d-81f8-2fc7350bdeae admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.146761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.147720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.148077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.148362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] PATH_INFO: `/v3/projects/e98816728b2b44cf90bd5ff419dc25b5` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.149611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ea07-17e8-4c9d-81f8-2fc7350bdeae admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.149719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98816728b2b44cf90bd5ff419dc25b5)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.151618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.154273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd954c-b4d3-4fbd-a1c5-624ff126506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.154905 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd954c-b4d3-4fbd-a1c5-624ff126506d admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.155196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd954c-b4d3-4fbd-a1c5-624ff126506d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.155466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd954c-b4d3-4fbd-a1c5-624ff126506d admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.156161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd954c-b4d3-4fbd-a1c5-624ff126506d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.158078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd954c-b4d3-4fbd-a1c5-624ff126506d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.186086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1016/2023] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:00.187190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd954c-b4d3-4fbd-a1c5-624ff126506d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.188820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-bdfd954c-b4d3-4fbd-a1c5-624ff126506d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.204320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98816728b2b44cf90bd5ff419dc25b5', 'request_id': 'req-9c1864f4-f270-4819-8548-52343de9916a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.210544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98816728b2b44cf90bd5ff419dc25b5', 'request_id': 'req-9c1864f4-f270-4819-8548-52343de9916a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.219082 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98816728b2b44cf90bd5ff419dc25b5', 'request_id': 'req-9c1864f4-f270-4819-8548-52343de9916a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.230052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] The token cache is being invalidate because project e98816728b2b44cf90bd5ff419dc25b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:00.230594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.230958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.232673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1008/2024] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:00 2022] DELETE /identity/v3/projects/e98816728b2b44cf90bd5ff419dc25b5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:00.238263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.238263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.245961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd954c-b4d3-4fbd-a1c5-624ff126506d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.293233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78095287-39b3-4cf9-bdf3-1299f630547f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.293927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095287-39b3-4cf9-bdf3-1299f630547f service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.294236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095287-39b3-4cf9-bdf3-1299f630547f service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.294581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095287-39b3-4cf9-bdf3-1299f630547f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.296359 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-78095287-39b3-4cf9-bdf3-1299f630547f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.296927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1864f4-f270-4819-8548-52343de9916a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.302337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bca54-5bb3-4a4d-a994-1e2a270a9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.303053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bca54-5bb3-4a4d-a994-1e2a270a9638 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.303353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bca54-5bb3-4a4d-a994-1e2a270a9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.303643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bca54-5bb3-4a4d-a994-1e2a270a9638 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.304437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bca54-5bb3-4a4d-a994-1e2a270a9638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.306285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bca54-5bb3-4a4d-a994-1e2a270a9638 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.308706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78095287-39b3-4cf9-bdf3-1299f630547f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.310483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78095287-39b3-4cf9-bdf3-1299f630547f service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.316991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1009/2025] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:00.317949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bca54-5bb3-4a4d-a994-1e2a270a9638 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.319666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8d7bca54-5bb3-4a4d-a994-1e2a270a9638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.322415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1017/2026] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:00.323731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d5832-af9e-47e2-ba75-c28a8ee8fff3 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.324087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d5832-af9e-47e2-ba75-c28a8ee8fff3 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.324429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d5832-af9e-47e2-ba75-c28a8ee8fff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.332900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bca54-5bb3-4a4d-a994-1e2a270a9638 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.337588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f335b-fa3d-42ed-bb50-82ef0dbbced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.338342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f335b-fa3d-42ed-bb50-82ef0dbbced3 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.338708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f335b-fa3d-42ed-bb50-82ef0dbbced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.339021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f335b-fa3d-42ed-bb50-82ef0dbbced3 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.339791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f335b-fa3d-42ed-bb50-82ef0dbbced3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.341778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f335b-fa3d-42ed-bb50-82ef0dbbced3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.342491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c99d5832-af9e-47e2-ba75-c28a8ee8fff3 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:00.343786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c99d5832-af9e-47e2-ba75-c28a8ee8fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.352482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1018/2027] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:00.353635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d5832-af9e-47e2-ba75-c28a8ee8fff3 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.363752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d5832-af9e-47e2-ba75-c28a8ee8fff3 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.368781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc2a8-0e96-45f9-9050-540294559eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.369935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc2a8-0e96-45f9-9050-540294559eed admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.370344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc2a8-0e96-45f9-9050-540294559eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.370722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc2a8-0e96-45f9-9050-540294559eed admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.371550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cc2a8-0e96-45f9-9050-540294559eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.373230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cc2a8-0e96-45f9-9050-540294559eed admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.377861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1010/2028] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/users => generated 284 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:00.377861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459346e7-ea14-49f4-9f19-af3ed639659c None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.377861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459346e7-ea14-49f4-9f19-af3ed639659c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.377861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459346e7-ea14-49f4-9f19-af3ed639659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.385492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1019/2029] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:00.385759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc2a8-0e96-45f9-9050-540294559eed admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.396719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc2a8-0e96-45f9-9050-540294559eed admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.399317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-459346e7-ea14-49f4-9f19-af3ed639659c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:00.400937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-459346e7-ea14-49f4-9f19-af3ed639659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.401928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd5f9-19b1-475f-a722-3da8afeedc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.402919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd5f9-19b1-475f-a722-3da8afeedc91 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.403038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd5f9-19b1-475f-a722-3da8afeedc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.403492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd5f9-19b1-475f-a722-3da8afeedc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.404504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd5f9-19b1-475f-a722-3da8afeedc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.406192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd5f9-19b1-475f-a722-3da8afeedc91 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.419913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1011/2030] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:00.420649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459346e7-ea14-49f4-9f19-af3ed639659c None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.421204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1020/2031] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:00.426424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd5f9-19b1-475f-a722-3da8afeedc91 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.435150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459346e7-ea14-49f4-9f19-af3ed639659c None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.446082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd5f9-19b1-475f-a722-3da8afeedc91 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.447271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66cdf3-5b60-454f-8e41-ac933bef478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.448530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66cdf3-5b60-454f-8e41-ac933bef478b admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.448954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66cdf3-5b60-454f-8e41-ac933bef478b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.449237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66cdf3-5b60-454f-8e41-ac933bef478b admin admin] PATH_INFO: `/v3/projects/75fc5dead879453695a0046c9f35ff1d/users/8c6f7ac9ef024f70bbc74961b4b7b7bc/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.451312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ff0fa-a25a-47ca-9b40-74028d35eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.452300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff0fa-a25a-47ca-9b40-74028d35eddd admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.452740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff0fa-a25a-47ca-9b40-74028d35eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.453163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff0fa-a25a-47ca-9b40-74028d35eddd admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.453946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ff0fa-a25a-47ca-9b40-74028d35eddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.455619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ff0fa-a25a-47ca-9b40-74028d35eddd admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.466518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1021/2032] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:00.467372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ff0fa-a25a-47ca-9b40-74028d35eddd admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.472493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66cdf3-5b60-454f-8e41-ac933bef478b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fc5dead879453695a0046c9f35ff1d, user_id=8c6f7ac9ef024f70bbc74961b4b7b7bc, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.475757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66cdf3-5b60-454f-8e41-ac933bef478b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.479478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ff0fa-a25a-47ca-9b40-74028d35eddd admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.489961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47b771-2e2e-4298-9aec-a6b63c62e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.491001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b771-2e2e-4298-9aec-a6b63c62e90d admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.491304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b771-2e2e-4298-9aec-a6b63c62e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.491723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b771-2e2e-4298-9aec-a6b63c62e90d admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.492618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1012/2033] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:00 2022] PUT /identity/v3/projects/75fc5dead879453695a0046c9f35ff1d/users/8c6f7ac9ef024f70bbc74961b4b7b7bc/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:00.492746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47b771-2e2e-4298-9aec-a6b63c62e90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:00.496872 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47b771-2e2e-4298-9aec-a6b63c62e90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.497020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66cdf3-5b60-454f-8e41-ac933bef478b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.497117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47b771-2e2e-4298-9aec-a6b63c62e90d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.511421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1022/2034] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:58:00.511421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7143190-e9f3-4da3-a23c-30eb6b6ece50 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.511421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7143190-e9f3-4da3-a23c-30eb6b6ece50 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.511421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7143190-e9f3-4da3-a23c-30eb6b6ece50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.530238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a7143190-e9f3-4da3-a23c-30eb6b6ece50 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:00.532357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a7143190-e9f3-4da3-a23c-30eb6b6ece50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.573677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66cdf3-5b60-454f-8e41-ac933bef478b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.579338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f64de-eac7-4418-8e6e-24af27a4d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.580463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f64de-eac7-4418-8e6e-24af27a4d4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.580993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f64de-eac7-4418-8e6e-24af27a4d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.581399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f64de-eac7-4418-8e6e-24af27a4d4c9 admin admin] PATH_INFO: `/v3/projects/cbbfe2df4f924542b6bd43356118817b/users/b52bc758f6574b0dbf5cdbcaae766f83/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.598572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f64de-eac7-4418-8e6e-24af27a4d4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbfe2df4f924542b6bd43356118817b, user_id=b52bc758f6574b0dbf5cdbcaae766f83, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.601461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f64de-eac7-4418-8e6e-24af27a4d4c9 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.607289 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1023/2035] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:00.608241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7143190-e9f3-4da3-a23c-30eb6b6ece50 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.619293 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7143190-e9f3-4da3-a23c-30eb6b6ece50 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.620510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1013/2036] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:00 2022] PUT /identity/v3/projects/cbbfe2df4f924542b6bd43356118817b/users/b52bc758f6574b0dbf5cdbcaae766f83/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:00.621198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f64de-eac7-4418-8e6e-24af27a4d4c9 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.622845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-402f64de-eac7-4418-8e6e-24af27a4d4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.694420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f64de-eac7-4418-8e6e-24af27a4d4c9 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.700221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303379aa-e22f-413f-9488-81266b4529b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.700901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303379aa-e22f-413f-9488-81266b4529b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.701192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303379aa-e22f-413f-9488-81266b4529b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.701557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303379aa-e22f-413f-9488-81266b4529b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.704941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618802d-bfc6-4089-9d00-de1ccd7b768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.705612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618802d-bfc6-4089-9d00-de1ccd7b768c admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.705891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618802d-bfc6-4089-9d00-de1ccd7b768c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.706253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618802d-bfc6-4089-9d00-de1ccd7b768c admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.707201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618802d-bfc6-4089-9d00-de1ccd7b768c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.708850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618802d-bfc6-4089-9d00-de1ccd7b768c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.712204 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303379aa-e22f-413f-9488-81266b4529b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.713802 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303379aa-e22f-413f-9488-81266b4529b2 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.723323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1014/2037] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:00.730843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96924f-0e1f-42f6-8802-77c21534e1b8 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.731139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96924f-0e1f-42f6-8802-77c21534e1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.731418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96924f-0e1f-42f6-8802-77c21534e1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.735665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1024/2038] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:00.736895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618802d-bfc6-4089-9d00-de1ccd7b768c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.741019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-2618802d-bfc6-4089-9d00-de1ccd7b768c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.761338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8d96924f-0e1f-42f6-8802-77c21534e1b8 None None] MFA Rules not processed for user `b52bc758f6574b0dbf5cdbcaae766f83`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:00.762708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8d96924f-0e1f-42f6-8802-77c21534e1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.812069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618802d-bfc6-4089-9d00-de1ccd7b768c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.822080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.823272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.823555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.823830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] PATH_INFO: `/v3/projects/9bc45121f4524abe808249c6e303758a` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.825708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc45121f4524abe808249c6e303758a)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.828447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.849880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1015/2039] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:00.849880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96924f-0e1f-42f6-8802-77c21534e1b8 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.858668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96924f-0e1f-42f6-8802-77c21534e1b8 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:00.863419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c837c4-d05c-4962-a9d5-f0f4ac807ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:00.864116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c837c4-d05c-4962-a9d5-f0f4ac807ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:00.864384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c837c4-d05c-4962-a9d5-f0f4ac807ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:00.864659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c837c4-d05c-4962-a9d5-f0f4ac807ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:00.865421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c837c4-d05c-4962-a9d5-f0f4ac807ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:00.867341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c837c4-d05c-4962-a9d5-f0f4ac807ad0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:00.887793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1016/2040] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:00 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:00.888674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c837c4-d05c-4962-a9d5-f0f4ac807ad0 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.894178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc45121f4524abe808249c6e303758a', 'request_id': 'req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.894841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-44c837c4-d05c-4962-a9d5-f0f4ac807ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.904258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc45121f4524abe808249c6e303758a', 'request_id': 'req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.911152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc45121f4524abe808249c6e303758a', 'request_id': 'req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.922369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] The token cache is being invalidate because project 9bc45121f4524abe808249c6e303758a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:00.922833 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.923617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:00.925528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1025/2041] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:00 2022] DELETE /identity/v3/projects/9bc45121f4524abe808249c6e303758a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:00.928908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:00.928908 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:00.964281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c837c4-d05c-4962-a9d5-f0f4ac807ad0 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:01.005529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bd0d1-2edd-48ed-a8d8-9a29cdf4f2a4 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:01.011981 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42283b-1eae-4590-9c5c-82141bb1ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:01.012838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42283b-1eae-4590-9c5c-82141bb1ce0e admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:01.013272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42283b-1eae-4590-9c5c-82141bb1ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:01.013681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42283b-1eae-4590-9c5c-82141bb1ce0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:01.015044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42283b-1eae-4590-9c5c-82141bb1ce0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:01.017626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42283b-1eae-4590-9c5c-82141bb1ce0e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:01.023077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b8811-835a-48fa-baab-ec5647bf8bfa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63b338ae7e374ba5a7542c5a53deb416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:01.023779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b8811-835a-48fa-baab-ec5647bf8bfa service glance] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:01.027428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b8811-835a-48fa-baab-ec5647bf8bfa service glance] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:01.027740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b8811-835a-48fa-baab-ec5647bf8bfa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:01.029829 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ab0b8811-835a-48fa-baab-ec5647bf8bfa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:01.031177 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1026/2042] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:01.032168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42283b-1eae-4590-9c5c-82141bb1ce0e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:01.043637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ef42283b-1eae-4590-9c5c-82141bb1ce0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:01.067112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42283b-1eae-4590-9c5c-82141bb1ce0e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:01.085304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:01.086449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:01.086731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:01.087032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] PATH_INFO: `/v3/users/6432308ccb6f4a1b9ab450875ef04c73` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:01.093443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6432308ccb6f4a1b9ab450875ef04c73)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:01.095812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:01.114281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b8811-835a-48fa-baab-ec5647bf8bfa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:01.116109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b8811-835a-48fa-baab-ec5647bf8bfa service glance] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:01.127011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1017/2043] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:01.128064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b8811-835a-48fa-baab-ec5647bf8bfa service glance] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:01.141733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b8811-835a-48fa-baab-ec5647bf8bfa service glance] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:01.147542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cebc20-c757-4163-ae59-98ce6332b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:01.148398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cebc20-c757-4163-ae59-98ce6332b768 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:01.148816 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cebc20-c757-4163-ae59-98ce6332b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:01.149484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cebc20-c757-4163-ae59-98ce6332b768 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:01.150360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cebc20-c757-4163-ae59-98ce6332b768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:01.152688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cebc20-c757-4163-ae59-98ce6332b768 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:01.179622 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1018/2044] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:01.183025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cebc20-c757-4163-ae59-98ce6332b768 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:01.183783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6432308ccb6f4a1b9ab450875ef04c73'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:01.193206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6432308ccb6f4a1b9ab450875ef04c73'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:01.194424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6432308ccb6f4a1b9ab450875ef04c73'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:01.195117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6432308ccb6f4a1b9ab450875ef04c73'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:01.209776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a73bb46-ec6f-4170-97a5-a9af0d08d603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6432308ccb6f4a1b9ab450875ef04c73'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:01.211127 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cebc20-c757-4163-ae59-98ce6332b768 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:01.221250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837cafd-8eaa-4112-9860-c7912631912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:01.222201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837cafd-8eaa-4112-9860-c7912631912b admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:01.222475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837cafd-8eaa-4112-9860-c7912631912b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:01.223115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837cafd-8eaa-4112-9860-c7912631912b admin admin] PATH_INFO: `/v3/projects/1c54e9c8d18644a5a5a87f74cb423549/users/cacc4eafe61c421084c8df2d8a638625/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:01.237607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1027/2045] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:01 2022] DELETE /identity/v3/users/6432308ccb6f4a1b9ab450875ef04c73 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:01.251047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837cafd-8eaa-4112-9860-c7912631912b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c54e9c8d18644a5a5a87f74cb423549, user_id=cacc4eafe61c421084c8df2d8a638625, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:01.254111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837cafd-8eaa-4112-9860-c7912631912b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:01.270251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1019/2046] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:01 2022] PUT /identity/v3/projects/1c54e9c8d18644a5a5a87f74cb423549/users/cacc4eafe61c421084c8df2d8a638625/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:01.280617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b46b81-9ed1-4d00-8036-ca3b432a7c4f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:01.281486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b46b81-9ed1-4d00-8036-ca3b432a7c4f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:01.281866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b46b81-9ed1-4d00-8036-ca3b432a7c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:01.330200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e1b46b81-9ed1-4d00-8036-ca3b432a7c4f None None] MFA Rules not processed for user `cacc4eafe61c421084c8df2d8a638625`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:01.331348 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e1b46b81-9ed1-4d00-8036-ca3b432a7c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:01.418416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1028/2047] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:01.431603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837cafd-8eaa-4112-9860-c7912631912b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:01.433396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e837cafd-8eaa-4112-9860-c7912631912b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:01.524106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837cafd-8eaa-4112-9860-c7912631912b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:01.531812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3848e4-74e2-429b-b025-af38112ddfc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:01.533789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3848e4-74e2-429b-b025-af38112ddfc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:01.534072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3848e4-74e2-429b-b025-af38112ddfc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:01.534357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3848e4-74e2-429b-b025-af38112ddfc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:01.555587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3848e4-74e2-429b-b025-af38112ddfc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:01.560029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3848e4-74e2-429b-b025-af38112ddfc9 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:01.580821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1020/2048] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:01.671085 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b46b81-9ed1-4d00-8036-ca3b432a7c4f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:01.673391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e1b46b81-9ed1-4d00-8036-ca3b432a7c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:01.825324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b46b81-9ed1-4d00-8036-ca3b432a7c4f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:01.836401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:01.838531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:01.840227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:01.840395 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] PATH_INFO: `/v3/projects/479a4a7ac72443b3889989a7de32d081` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:01.843728 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=479a4a7ac72443b3889989a7de32d081)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:01.846080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:01.993369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479a4a7ac72443b3889989a7de32d081', 'request_id': 'req-92d19cad-322b-405e-a2fb-c9f64eebbfc1'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:02.022884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479a4a7ac72443b3889989a7de32d081', 'request_id': 'req-92d19cad-322b-405e-a2fb-c9f64eebbfc1'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:02.035493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479a4a7ac72443b3889989a7de32d081', 'request_id': 'req-92d19cad-322b-405e-a2fb-c9f64eebbfc1'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:02.062849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] The token cache is being invalidate because project 479a4a7ac72443b3889989a7de32d081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:02.063150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:02.065447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-92d19cad-322b-405e-a2fb-c9f64eebbfc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:02.067438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1029/2049] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:01 2022] DELETE /identity/v3/projects/479a4a7ac72443b3889989a7de32d081 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:02.072779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be63a6-ebad-409c-a253-e0d9a2f12efc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.073244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be63a6-ebad-409c-a253-e0d9a2f12efc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.073677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be63a6-ebad-409c-a253-e0d9a2f12efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.106827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a5be63a6-ebad-409c-a253-e0d9a2f12efc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:02.108312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a5be63a6-ebad-409c-a253-e0d9a2f12efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:02.219845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1021/2050] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:02.227848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88fdd-cc72-4151-9114-b11ae2912b36 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.228385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88fdd-cc72-4151-9114-b11ae2912b36 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.228817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88fdd-cc72-4151-9114-b11ae2912b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.255954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-32a88fdd-cc72-4151-9114-b11ae2912b36 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:02.257473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-32a88fdd-cc72-4151-9114-b11ae2912b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:02.268233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1030/2051] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:02.272605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be63a6-ebad-409c-a253-e0d9a2f12efc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:02.282245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be63a6-ebad-409c-a253-e0d9a2f12efc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:02.287072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05d67c-8f2e-457a-bc68-6d13aa42cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:02.287774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d67c-8f2e-457a-bc68-6d13aa42cb6e admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.288060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d67c-8f2e-457a-bc68-6d13aa42cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.288336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d67c-8f2e-457a-bc68-6d13aa42cb6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.289101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05d67c-8f2e-457a-bc68-6d13aa42cb6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:02.289419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05d67c-8f2e-457a-bc68-6d13aa42cb6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:02.291216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05d67c-8f2e-457a-bc68-6d13aa42cb6e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:02.305835 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1022/2052] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:58:02.311614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88fdd-cc72-4151-9114-b11ae2912b36 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:02.322731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88fdd-cc72-4151-9114-b11ae2912b36 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:02.328243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2709e1-3048-4f75-841b-387ef204af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:02.329026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2709e1-3048-4f75-841b-387ef204af0c admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.329318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2709e1-3048-4f75-841b-387ef204af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.329749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2709e1-3048-4f75-841b-387ef204af0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.330737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2709e1-3048-4f75-841b-387ef204af0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:02.333810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2709e1-3048-4f75-841b-387ef204af0c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:02.380213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1031/2053] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:02 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:58:02.383870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05d67c-8f2e-457a-bc68-6d13aa42cb6e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:02.397074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05d67c-8f2e-457a-bc68-6d13aa42cb6e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:02.482691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11315a-952f-422d-bf26-e86a8387b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:02.484556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11315a-952f-422d-bf26-e86a8387b317 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.484556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11315a-952f-422d-bf26-e86a8387b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.484758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11315a-952f-422d-bf26-e86a8387b317 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.485503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11315a-952f-422d-bf26-e86a8387b317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:02.487536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11315a-952f-422d-bf26-e86a8387b317 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:02.520199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1023/2054] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:02 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:58:02.524768 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2709e1-3048-4f75-841b-387ef204af0c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:02.539417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2709e1-3048-4f75-841b-387ef204af0c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:02.548073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fd4c1-7c6d-4c6e-b6af-d0c12da40e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:02.548892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fd4c1-7c6d-4c6e-b6af-d0c12da40e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.549190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fd4c1-7c6d-4c6e-b6af-d0c12da40e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.549499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fd4c1-7c6d-4c6e-b6af-d0c12da40e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.550255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fd4c1-7c6d-4c6e-b6af-d0c12da40e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:02.552021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fd4c1-7c6d-4c6e-b6af-d0c12da40e8c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:02.566064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1032/2055] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:02.567596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11315a-952f-422d-bf26-e86a8387b317 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:02.581855 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11315a-952f-422d-bf26-e86a8387b317 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:02.591436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667089-f8df-47fd-9f8c-dc2a9b675c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:02.591823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667089-f8df-47fd-9f8c-dc2a9b675c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.592115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667089-f8df-47fd-9f8c-dc2a9b675c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.592382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667089-f8df-47fd-9f8c-dc2a9b675c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.593450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32667089-f8df-47fd-9f8c-dc2a9b675c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:02.595213 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32667089-f8df-47fd-9f8c-dc2a9b675c53 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:02.610125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1024/2056] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:02.611378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fd4c1-7c6d-4c6e-b6af-d0c12da40e8c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:02.623045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fd4c1-7c6d-4c6e-b6af-d0c12da40e8c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:02.630031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cef206-490e-4efc-981c-8c11943f80f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:02.631135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cef206-490e-4efc-981c-8c11943f80f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.631534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cef206-490e-4efc-981c-8c11943f80f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.631943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cef206-490e-4efc-981c-8c11943f80f4 admin admin] PATH_INFO: `/v3/projects/e775a73e5c5e40309c1b3b1021f9e791/users/e142694a9bc041f984c74742b931c492/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.651655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cef206-490e-4efc-981c-8c11943f80f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e775a73e5c5e40309c1b3b1021f9e791, user_id=e142694a9bc041f984c74742b931c492, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:02.654513 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cef206-490e-4efc-981c-8c11943f80f4 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:02.673987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1033/2057] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:02 2022] PUT /identity/v3/projects/e775a73e5c5e40309c1b3b1021f9e791/users/e142694a9bc041f984c74742b931c492/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:02.686557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42e12-eba6-4644-9694-d8cc2cb5ae58 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.687118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42e12-eba6-4644-9694-d8cc2cb5ae58 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.687398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42e12-eba6-4644-9694-d8cc2cb5ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.766341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-1af42e12-eba6-4644-9694-d8cc2cb5ae58 None None] MFA Rules not processed for user `e142694a9bc041f984c74742b931c492`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:02.767687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1af42e12-eba6-4644-9694-d8cc2cb5ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:02.873594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1025/2058] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:02.878293 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cef206-490e-4efc-981c-8c11943f80f4 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:02.970243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cef206-490e-4efc-981c-8c11943f80f4 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:02.976375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3429e1-8701-45e7-93f7-fe371f021a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:02.976628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3429e1-8701-45e7-93f7-fe371f021a87 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:02.976980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3429e1-8701-45e7-93f7-fe371f021a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:02.981363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3429e1-8701-45e7-93f7-fe371f021a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:02.981363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3429e1-8701-45e7-93f7-fe371f021a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:02.981363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3429e1-8701-45e7-93f7-fe371f021a87 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:03.021662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1034/2059] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:02 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:03.026027 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42e12-eba6-4644-9694-d8cc2cb5ae58 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:03.044096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42e12-eba6-4644-9694-d8cc2cb5ae58 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:03.105193 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c5b14-7e84-4b15-8993-3e22437dc476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:03.105940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c5b14-7e84-4b15-8993-3e22437dc476 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:03.106221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c5b14-7e84-4b15-8993-3e22437dc476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:03.106496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c5b14-7e84-4b15-8993-3e22437dc476 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:03.107235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c5b14-7e84-4b15-8993-3e22437dc476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:03.109181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c5b14-7e84-4b15-8993-3e22437dc476 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:03.136013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1026/2060] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:03 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:03.137179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3429e1-8701-45e7-93f7-fe371f021a87 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:03.158371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3429e1-8701-45e7-93f7-fe371f021a87 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:03.163972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174101f-419b-4668-bea5-17d2b5704810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:03.164755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174101f-419b-4668-bea5-17d2b5704810 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:03.165138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174101f-419b-4668-bea5-17d2b5704810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:03.165613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174101f-419b-4668-bea5-17d2b5704810 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:03.166507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174101f-419b-4668-bea5-17d2b5704810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:03.168217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174101f-419b-4668-bea5-17d2b5704810 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:03.180730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1035/2061] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:58:03.192209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c5b14-7e84-4b15-8993-3e22437dc476 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:03.202288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c5b14-7e84-4b15-8993-3e22437dc476 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:03.207192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b83325-2be3-41ff-aacd-b2217d2646ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:03.208093 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b83325-2be3-41ff-aacd-b2217d2646ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:03.208370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b83325-2be3-41ff-aacd-b2217d2646ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:03.208670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b83325-2be3-41ff-aacd-b2217d2646ac admin admin] PATH_INFO: `/v3/projects/a0f380975bcb4e0cb1159669ee3d3bcd/users/d99ab9ac285a492a8de7797f5aee3c76/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:03.229387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b83325-2be3-41ff-aacd-b2217d2646ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f380975bcb4e0cb1159669ee3d3bcd, user_id=d99ab9ac285a492a8de7797f5aee3c76, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:03.229569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b83325-2be3-41ff-aacd-b2217d2646ac admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:03.255009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1027/2062] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:03 2022] PUT /identity/v3/projects/a0f380975bcb4e0cb1159669ee3d3bcd/users/d99ab9ac285a492a8de7797f5aee3c76/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:03.256877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174101f-419b-4668-bea5-17d2b5704810 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:03.269574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174101f-419b-4668-bea5-17d2b5704810 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:03.349255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1ec0b-f124-4249-b830-784d73a203a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:03.350013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1ec0b-f124-4249-b830-784d73a203a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:03.350454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1ec0b-f124-4249-b830-784d73a203a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:03.350840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1ec0b-f124-4249-b830-784d73a203a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:03.351848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1ec0b-f124-4249-b830-784d73a203a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:03.353901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1ec0b-f124-4249-b830-784d73a203a8 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:03.374047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1036/2063] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:03.374952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b83325-2be3-41ff-aacd-b2217d2646ac admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:03.392531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b83325-2be3-41ff-aacd-b2217d2646ac admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:03.398400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1263aee-da61-4166-bb21-ce8e22be5152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:03.406755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1263aee-da61-4166-bb21-ce8e22be5152 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:03.407984 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1263aee-da61-4166-bb21-ce8e22be5152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:03.408384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1263aee-da61-4166-bb21-ce8e22be5152 admin admin] PATH_INFO: `/v3/projects/a0f380975bcb4e0cb1159669ee3d3bcd/users/d99ab9ac285a492a8de7797f5aee3c76/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:03.415723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1263aee-da61-4166-bb21-ce8e22be5152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f380975bcb4e0cb1159669ee3d3bcd, user_id=d99ab9ac285a492a8de7797f5aee3c76, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:03.418438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1263aee-da61-4166-bb21-ce8e22be5152 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:03.430813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1028/2064] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:03 2022] PUT /identity/v3/projects/a0f380975bcb4e0cb1159669ee3d3bcd/users/d99ab9ac285a492a8de7797f5aee3c76/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:58:03.447545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22775f-02eb-494d-93fd-d6dcd4b3c609 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:03.447830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22775f-02eb-494d-93fd-d6dcd4b3c609 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:03.450702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22775f-02eb-494d-93fd-d6dcd4b3c609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:03.482846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-cc22775f-02eb-494d-93fd-d6dcd4b3c609 None None] MFA Rules not processed for user `d99ab9ac285a492a8de7797f5aee3c76`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:03.484237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cc22775f-02eb-494d-93fd-d6dcd4b3c609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:03.566111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1037/2065] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:03.573907 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1263aee-da61-4166-bb21-ce8e22be5152 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:03.575850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d1263aee-da61-4166-bb21-ce8e22be5152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:03.663463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1263aee-da61-4166-bb21-ce8e22be5152 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:03.667585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99157a8d-af3c-4f6f-a8ab-39fa3b00af63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:03.668389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99157a8d-af3c-4f6f-a8ab-39fa3b00af63 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:03.668772 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99157a8d-af3c-4f6f-a8ab-39fa3b00af63 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:03.669146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99157a8d-af3c-4f6f-a8ab-39fa3b00af63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:03.687351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99157a8d-af3c-4f6f-a8ab-39fa3b00af63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:03.689777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99157a8d-af3c-4f6f-a8ab-39fa3b00af63 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:03.703540 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1029/2066] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:04.434532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22775f-02eb-494d-93fd-d6dcd4b3c609 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:04.436546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cc22775f-02eb-494d-93fd-d6dcd4b3c609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:04.518651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22775f-02eb-494d-93fd-d6dcd4b3c609 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:04.537030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:04.538056 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:04.538343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:04.538622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] PATH_INFO: `/v3/users/cacc4eafe61c421084c8df2d8a638625` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:04.540573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cacc4eafe61c421084c8df2d8a638625)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:04.542867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:04.609111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cacc4eafe61c421084c8df2d8a638625'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:04.617370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cacc4eafe61c421084c8df2d8a638625'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:04.618183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cacc4eafe61c421084c8df2d8a638625'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:04.618912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cacc4eafe61c421084c8df2d8a638625'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:04.630686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cacc4eafe61c421084c8df2d8a638625'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:04.663412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1038/2067] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:04 2022] DELETE /identity/v3/users/cacc4eafe61c421084c8df2d8a638625 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:04.669742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657ec7-167b-448b-8f14-adbef36bf367 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:04.670259 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657ec7-167b-448b-8f14-adbef36bf367 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:04.670553 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657ec7-167b-448b-8f14-adbef36bf367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:04.693480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-62657ec7-167b-448b-8f14-adbef36bf367 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:04.695514 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-62657ec7-167b-448b-8f14-adbef36bf367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:04.826193 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1030/2068] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:04.832946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:04.834506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:05.006611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d514e1-45b0-4589-a242-ec64008058b9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:05.013744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1bc11-518b-4a47-ba4b-2e98b3b0d5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:05.014873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1bc11-518b-4a47-ba4b-2e98b3b0d5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:05.016880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1bc11-518b-4a47-ba4b-2e98b3b0d5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:05.017350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1bc11-518b-4a47-ba4b-2e98b3b0d5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:05.038273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1bc11-518b-4a47-ba4b-2e98b3b0d5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:05.040023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1bc11-518b-4a47-ba4b-2e98b3b0d5c8 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:05.091005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1039/2069] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:05.583709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657ec7-167b-448b-8f14-adbef36bf367 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:05.585805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-62657ec7-167b-448b-8f14-adbef36bf367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:05.602515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657ec7-167b-448b-8f14-adbef36bf367 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:05.608000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:05.611268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:05.611622 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:05.612157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] PATH_INFO: `/v3/projects/1c54e9c8d18644a5a5a87f74cb423549` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:05.614263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c54e9c8d18644a5a5a87f74cb423549)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:05.616303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:05.705206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c54e9c8d18644a5a5a87f74cb423549', 'request_id': 'req-72b2c45f-3728-43c2-a5a3-585cd3102d6e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:05.719309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c54e9c8d18644a5a5a87f74cb423549', 'request_id': 'req-72b2c45f-3728-43c2-a5a3-585cd3102d6e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:05.736567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c54e9c8d18644a5a5a87f74cb423549', 'request_id': 'req-72b2c45f-3728-43c2-a5a3-585cd3102d6e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:05.754235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] The token cache is being invalidate because project 1c54e9c8d18644a5a5a87f74cb423549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:05.754778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:05.756700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-72b2c45f-3728-43c2-a5a3-585cd3102d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:05.758806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1031/2070] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:05 2022] DELETE /identity/v3/projects/1c54e9c8d18644a5a5a87f74cb423549 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:05.765119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e37ac1-7908-4e18-a592-7102474a0f08 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:05.766012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e37ac1-7908-4e18-a592-7102474a0f08 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:05.766012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e37ac1-7908-4e18-a592-7102474a0f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:05.814966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-94e37ac1-7908-4e18-a592-7102474a0f08 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:05.816228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-94e37ac1-7908-4e18-a592-7102474a0f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:05.937691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1040/2071] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:05.945315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dd8c0-703f-4973-a766-0bf0ce93d46e None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:05.945808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dd8c0-703f-4973-a766-0bf0ce93d46e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:05.946242 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dd8c0-703f-4973-a766-0bf0ce93d46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.008098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e37ac1-7908-4e18-a592-7102474a0f08 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.010030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-94e37ac1-7908-4e18-a592-7102474a0f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:06.012045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d59dd8c0-703f-4973-a766-0bf0ce93d46e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:06.013402 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d59dd8c0-703f-4973-a766-0bf0ce93d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:06.024499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e37ac1-7908-4e18-a592-7102474a0f08 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.024696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1032/2072] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:06.029020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dd8c0-703f-4973-a766-0bf0ce93d46e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.033061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.034068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.034459 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.034801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] PATH_INFO: `/v3/users/e142694a9bc041f984c74742b931c492` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.036123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e142694a9bc041f984c74742b931c492)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:06.038183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:06.041276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dd8c0-703f-4973-a766-0bf0ce93d46e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.060610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282120a-b39c-44ba-b92c-f0e5801caa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.061648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282120a-b39c-44ba-b92c-f0e5801caa4a admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.062086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282120a-b39c-44ba-b92c-f0e5801caa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.062363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282120a-b39c-44ba-b92c-f0e5801caa4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.063301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282120a-b39c-44ba-b92c-f0e5801caa4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:06.063613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282120a-b39c-44ba-b92c-f0e5801caa4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:06.065354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282120a-b39c-44ba-b92c-f0e5801caa4a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:06.082077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1033/2073] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:58:06.087214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282120a-b39c-44ba-b92c-f0e5801caa4a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.115875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282120a-b39c-44ba-b92c-f0e5801caa4a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.117257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e142694a9bc041f984c74742b931c492'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:06.122610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5551c9-0428-4a96-8de6-f915c97f75a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.123786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5551c9-0428-4a96-8de6-f915c97f75a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.125149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5551c9-0428-4a96-8de6-f915c97f75a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.125475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5551c9-0428-4a96-8de6-f915c97f75a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.126437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5551c9-0428-4a96-8de6-f915c97f75a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:06.128539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5551c9-0428-4a96-8de6-f915c97f75a4 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:06.133479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e142694a9bc041f984c74742b931c492'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:06.142589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e142694a9bc041f984c74742b931c492'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:06.143876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e142694a9bc041f984c74742b931c492'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:06.157470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2c69fdee-fa52-4565-99e3-440e468583e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e142694a9bc041f984c74742b931c492'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:06.180058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1034/2074] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:06 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:58:06.184483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5551c9-0428-4a96-8de6-f915c97f75a4 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.186704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1041/2075] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:06 2022] DELETE /identity/v3/users/e142694a9bc041f984c74742b931c492 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:58:06.191536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bdd11-b2f4-4da0-8e22-ed621b636a82 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.191649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bdd11-b2f4-4da0-8e22-ed621b636a82 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.191906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bdd11-b2f4-4da0-8e22-ed621b636a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.199869 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-fc5551c9-0428-4a96-8de6-f915c97f75a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:06.224155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-385bdd11-b2f4-4da0-8e22-ed621b636a82 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:06.226780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-385bdd11-b2f4-4da0-8e22-ed621b636a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:06.344298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5551c9-0428-4a96-8de6-f915c97f75a4 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.362032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1042/2076] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:06.374274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bdd11-b2f4-4da0-8e22-ed621b636a82 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.387144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-385bdd11-b2f4-4da0-8e22-ed621b636a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:06.467620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ede80-5bd1-4e52-8977-3fa77dc6d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.469656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ede80-5bd1-4e52-8977-3fa77dc6d235 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.470153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ede80-5bd1-4e52-8977-3fa77dc6d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.470587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ede80-5bd1-4e52-8977-3fa77dc6d235 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.472291 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ede80-5bd1-4e52-8977-3fa77dc6d235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:06.475711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ede80-5bd1-4e52-8977-3fa77dc6d235 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:06.497211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bdd11-b2f4-4da0-8e22-ed621b636a82 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.516381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccdee6-5274-4bf9-b58b-0eef534865d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.517095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccdee6-5274-4bf9-b58b-0eef534865d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.517415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccdee6-5274-4bf9-b58b-0eef534865d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.517694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccdee6-5274-4bf9-b58b-0eef534865d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.521998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1035/2077] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:06 2022] POST /identity/v3/users => generated 283 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:58:06.521998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c86ea-8774-48c5-ae3b-f5b1448c5912 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.521998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c86ea-8774-48c5-ae3b-f5b1448c5912 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.521998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c86ea-8774-48c5-ae3b-f5b1448c5912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.533946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccdee6-5274-4bf9-b58b-0eef534865d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:06.535822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccdee6-5274-4bf9-b58b-0eef534865d6 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:06.552565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1043/2078] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:06.553418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccdee6-5274-4bf9-b58b-0eef534865d6 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.557754 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a67c86ea-8774-48c5-ae3b-f5b1448c5912 None None] MFA Rules not processed for user `8c6f7ac9ef024f70bbc74961b4b7b7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:06.558998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a67c86ea-8774-48c5-ae3b-f5b1448c5912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:06.565266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccdee6-5274-4bf9-b58b-0eef534865d6 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.571103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7ce74-21e1-4800-9770-aa5e461a4ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.572253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7ce74-21e1-4800-9770-aa5e461a4ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.572793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7ce74-21e1-4800-9770-aa5e461a4ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.572793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7ce74-21e1-4800-9770-aa5e461a4ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.573611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7ce74-21e1-4800-9770-aa5e461a4ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:06.576534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7ce74-21e1-4800-9770-aa5e461a4ff3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:06.592715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1044/2079] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:06.594418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7ce74-21e1-4800-9770-aa5e461a4ff3 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.609355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7ce74-21e1-4800-9770-aa5e461a4ff3 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.616662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d0166-e762-448b-b3d5-28a1e890578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.617988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d0166-e762-448b-b3d5-28a1e890578c admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.618367 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d0166-e762-448b-b3d5-28a1e890578c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.618817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d0166-e762-448b-b3d5-28a1e890578c admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.620009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d0166-e762-448b-b3d5-28a1e890578c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:06.622500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d0166-e762-448b-b3d5-28a1e890578c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:06.638844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1045/2080] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:06.640283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d0166-e762-448b-b3d5-28a1e890578c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.651535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d0166-e762-448b-b3d5-28a1e890578c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.657500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4659186-919e-4d40-9275-92280ffee180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.658864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659186-919e-4d40-9275-92280ffee180 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.659307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659186-919e-4d40-9275-92280ffee180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.659785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659186-919e-4d40-9275-92280ffee180 admin admin] PATH_INFO: `/v3/projects/db6a31b239a2435faa31560ce7b0eda8/users/56a3f9a98a1443acb67637d40124e4b0/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.665262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1036/2081] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:06.676303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c86ea-8774-48c5-ae3b-f5b1448c5912 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.677919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a67c86ea-8774-48c5-ae3b-f5b1448c5912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:06.684844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4659186-919e-4d40-9275-92280ffee180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6a31b239a2435faa31560ce7b0eda8, user_id=56a3f9a98a1443acb67637d40124e4b0, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:06.689050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4659186-919e-4d40-9275-92280ffee180 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:06.719103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1046/2082] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:06 2022] PUT /identity/v3/projects/db6a31b239a2435faa31560ce7b0eda8/users/56a3f9a98a1443acb67637d40124e4b0/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:06.730985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283a26-7656-4893-a6da-8e4fd17ff612 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.731286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283a26-7656-4893-a6da-8e4fd17ff612 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.731567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283a26-7656-4893-a6da-8e4fd17ff612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.782180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-36283a26-7656-4893-a6da-8e4fd17ff612 None None] MFA Rules not processed for user `56a3f9a98a1443acb67637d40124e4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:06.784374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-36283a26-7656-4893-a6da-8e4fd17ff612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:06.837236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c86ea-8774-48c5-ae3b-f5b1448c5912 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.871428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1047/2083] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:06.883631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36283a26-7656-4893-a6da-8e4fd17ff612 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:06.885554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-36283a26-7656-4893-a6da-8e4fd17ff612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:06.956310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3e5e5-f06b-4620-9bd3-00818482b901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.956897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3e5e5-f06b-4620-9bd3-00818482b901 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.957364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3e5e5-f06b-4620-9bd3-00818482b901 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.957769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3e5e5-f06b-4620-9bd3-00818482b901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.960829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36283a26-7656-4893-a6da-8e4fd17ff612 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:06.971640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58800c-234c-4348-a521-3f27ce0e44e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:06.972640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58800c-234c-4348-a521-3f27ce0e44e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:06.972922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58800c-234c-4348-a521-3f27ce0e44e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:06.973202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58800c-234c-4348-a521-3f27ce0e44e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:06.985136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58800c-234c-4348-a521-3f27ce0e44e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:06.986916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58800c-234c-4348-a521-3f27ce0e44e3 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:07.000344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1048/2084] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:58:07.001915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58800c-234c-4348-a521-3f27ce0e44e3 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:07.003753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fe58800c-234c-4348-a521-3f27ce0e44e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:07.054090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3e5e5-f06b-4620-9bd3-00818482b901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:07.056911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3e5e5-f06b-4620-9bd3-00818482b901 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:07.069753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1037/2085] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:58:07.125515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58800c-234c-4348-a521-3f27ce0e44e3 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:07.130388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:07.131316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:07.131596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:07.131868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] PATH_INFO: `/v3/projects/e775a73e5c5e40309c1b3b1021f9e791` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:07.133051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e775a73e5c5e40309c1b3b1021f9e791)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:07.135225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:07.189873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e775a73e5c5e40309c1b3b1021f9e791', 'request_id': 'req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.198133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e775a73e5c5e40309c1b3b1021f9e791', 'request_id': 'req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.205382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e775a73e5c5e40309c1b3b1021f9e791', 'request_id': 'req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.216689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] The token cache is being invalidate because project e775a73e5c5e40309c1b3b1021f9e791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:07.216689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.217520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.219265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1049/2086] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:07 2022] DELETE /identity/v3/projects/e775a73e5c5e40309c1b3b1021f9e791 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:07.223505 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3e5e5-f06b-4620-9bd3-00818482b901 service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:07.239114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3e5e5-f06b-4620-9bd3-00818482b901 service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:07.315103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:07.316133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:07.316419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:07.316698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] PATH_INFO: `/v3/users/d99ab9ac285a492a8de7797f5aee3c76` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:07.317957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d99ab9ac285a492a8de7797f5aee3c76)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:07.319989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:07.434411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd99ab9ac285a492a8de7797f5aee3c76'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.442197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd99ab9ac285a492a8de7797f5aee3c76'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.443148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd99ab9ac285a492a8de7797f5aee3c76'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.443964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd99ab9ac285a492a8de7797f5aee3c76'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.456299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-fe3c2172-12fc-4d36-8405-49b019e2030d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd99ab9ac285a492a8de7797f5aee3c76'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:07.491693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1038/2087] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:07 2022] DELETE /identity/v3/users/d99ab9ac285a492a8de7797f5aee3c76 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:07.883037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:07.887401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:07.904387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3202f4-77cd-41d4-ade6-b2f30d24eb85 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:07.993326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:07.993326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:07.993326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:07.993326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] PATH_INFO: `/v3/projects/a0f380975bcb4e0cb1159669ee3d3bcd` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:07.993892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f380975bcb4e0cb1159669ee3d3bcd)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:07.995209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:08.059312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f380975bcb4e0cb1159669ee3d3bcd', 'request_id': 'req-69b930d1-f903-4f3d-9c4e-64e55db0e124'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:08.073740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f380975bcb4e0cb1159669ee3d3bcd', 'request_id': 'req-69b930d1-f903-4f3d-9c4e-64e55db0e124'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:08.080759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f380975bcb4e0cb1159669ee3d3bcd', 'request_id': 'req-69b930d1-f903-4f3d-9c4e-64e55db0e124'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:08.093663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] The token cache is being invalidate because project a0f380975bcb4e0cb1159669ee3d3bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:08.094713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:08.096009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69b930d1-f903-4f3d-9c4e-64e55db0e124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:08.098636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1050/2088] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:07 2022] DELETE /identity/v3/projects/a0f380975bcb4e0cb1159669ee3d3bcd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:08.103670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2d28a-891b-4050-97a4-4977e04d101f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:08.104254 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2d28a-891b-4050-97a4-4977e04d101f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:08.104254 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2d28a-891b-4050-97a4-4977e04d101f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:08.127919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-b0e2d28a-891b-4050-97a4-4977e04d101f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:08.129149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b0e2d28a-891b-4050-97a4-4977e04d101f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:08.202683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1039/2089] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:08.210947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f786f-4fdb-4cc7-9552-e3fb17f1564f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:08.211314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f786f-4fdb-4cc7-9552-e3fb17f1564f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:08.212126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f786f-4fdb-4cc7-9552-e3fb17f1564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:08.230555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-4d0f786f-4fdb-4cc7-9552-e3fb17f1564f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:08.231860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4d0f786f-4fdb-4cc7-9552-e3fb17f1564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:08.240237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1051/2090] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:08.244881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2d28a-891b-4050-97a4-4977e04d101f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:08.254672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2d28a-891b-4050-97a4-4977e04d101f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:08.260263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986bd91-5de9-47d9-8441-bf72ad593d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:08.261143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986bd91-5de9-47d9-8441-bf72ad593d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:08.261645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986bd91-5de9-47d9-8441-bf72ad593d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:08.261935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986bd91-5de9-47d9-8441-bf72ad593d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:08.262710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986bd91-5de9-47d9-8441-bf72ad593d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:08.263029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986bd91-5de9-47d9-8441-bf72ad593d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:08.264798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986bd91-5de9-47d9-8441-bf72ad593d23 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:08.278350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1040/2091] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:58:08.283106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f786f-4fdb-4cc7-9552-e3fb17f1564f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:08.293632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f786f-4fdb-4cc7-9552-e3fb17f1564f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:08.299963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b248d57-ac08-4e88-91bb-f9c7bd8691db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:08.300743 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b248d57-ac08-4e88-91bb-f9c7bd8691db admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:08.301130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b248d57-ac08-4e88-91bb-f9c7bd8691db admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:08.301514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b248d57-ac08-4e88-91bb-f9c7bd8691db admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:08.302353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b248d57-ac08-4e88-91bb-f9c7bd8691db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:08.304491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b248d57-ac08-4e88-91bb-f9c7bd8691db admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:08.334731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1052/2092] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:08 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:08.339123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986bd91-5de9-47d9-8441-bf72ad593d23 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:08.349273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986bd91-5de9-47d9-8441-bf72ad593d23 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:08.426657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392c449-a74a-40bc-a5f7-00404b88fb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:08.427350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392c449-a74a-40bc-a5f7-00404b88fb16 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:08.427631 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392c449-a74a-40bc-a5f7-00404b88fb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:08.427899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392c449-a74a-40bc-a5f7-00404b88fb16 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:08.428820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392c449-a74a-40bc-a5f7-00404b88fb16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:08.431753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392c449-a74a-40bc-a5f7-00404b88fb16 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:08.491154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1041/2093] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:08 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:08.495189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b248d57-ac08-4e88-91bb-f9c7bd8691db admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:08.507539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b248d57-ac08-4e88-91bb-f9c7bd8691db admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:08.513823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc48ed5-31cd-4cda-816d-3a10fdb1f0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:08.514542 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc48ed5-31cd-4cda-816d-3a10fdb1f0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:08.514779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc48ed5-31cd-4cda-816d-3a10fdb1f0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:08.515355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc48ed5-31cd-4cda-816d-3a10fdb1f0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:08.516408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc48ed5-31cd-4cda-816d-3a10fdb1f0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:08.528362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc48ed5-31cd-4cda-816d-3a10fdb1f0e1 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:08.556415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1053/2094] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:08.560870 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392c449-a74a-40bc-a5f7-00404b88fb16 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:08.574250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392c449-a74a-40bc-a5f7-00404b88fb16 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:08.599570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54073bd1-a133-4b61-9d4d-d2ad0035e5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:08.600629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54073bd1-a133-4b61-9d4d-d2ad0035e5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:08.601120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54073bd1-a133-4b61-9d4d-d2ad0035e5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:08.602072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54073bd1-a133-4b61-9d4d-d2ad0035e5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:08.615981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54073bd1-a133-4b61-9d4d-d2ad0035e5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:08.620048 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54073bd1-a133-4b61-9d4d-d2ad0035e5f6 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:08.643846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1042/2095] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:08.647859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc48ed5-31cd-4cda-816d-3a10fdb1f0e1 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:08.664291 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc48ed5-31cd-4cda-816d-3a10fdb1f0e1 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:08.678399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b6d9-bd74-4cc0-b6d9-bf2f1f42a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:08.678399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b6d9-bd74-4cc0-b6d9-bf2f1f42a650 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:08.678399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b6d9-bd74-4cc0-b6d9-bf2f1f42a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:08.678399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b6d9-bd74-4cc0-b6d9-bf2f1f42a650 admin admin] PATH_INFO: `/v3/projects/abf6a135bf824df98f43ee4f986e945e/users/1710cdcea49942b7870e6a04e1190505/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:08.717193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8b6d9-bd74-4cc0-b6d9-bf2f1f42a650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf6a135bf824df98f43ee4f986e945e, user_id=1710cdcea49942b7870e6a04e1190505, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:08.717193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8b6d9-bd74-4cc0-b6d9-bf2f1f42a650 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:08.736742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1054/2096] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:08 2022] PUT /identity/v3/projects/abf6a135bf824df98f43ee4f986e945e/users/1710cdcea49942b7870e6a04e1190505/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:08.753812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15298-6d4f-4071-ad71-08829f9835d9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:08.755474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15298-6d4f-4071-ad71-08829f9835d9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:08.756081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15298-6d4f-4071-ad71-08829f9835d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:08.818979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-4aa15298-6d4f-4071-ad71-08829f9835d9 None None] MFA Rules not processed for user `1710cdcea49942b7870e6a04e1190505`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:08.821935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4aa15298-6d4f-4071-ad71-08829f9835d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:08.996677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1043/2097] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:09.001412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b6d9-bd74-4cc0-b6d9-bf2f1f42a650 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:09.085760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b6d9-bd74-4cc0-b6d9-bf2f1f42a650 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:09.091791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2735a9-827f-4416-99a4-2d281467c36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:09.093005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2735a9-827f-4416-99a4-2d281467c36e admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:09.093467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2735a9-827f-4416-99a4-2d281467c36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:09.093907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2735a9-827f-4416-99a4-2d281467c36e admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:09.094821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2735a9-827f-4416-99a4-2d281467c36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:09.097180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2735a9-827f-4416-99a4-2d281467c36e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:09.175647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1055/2098] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:09 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:09.179873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15298-6d4f-4071-ad71-08829f9835d9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:09.192278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15298-6d4f-4071-ad71-08829f9835d9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:09.279432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040be83-185f-4014-ac8e-1984ac3c4ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:09.280171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040be83-185f-4014-ac8e-1984ac3c4ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:09.280442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040be83-185f-4014-ac8e-1984ac3c4ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:09.280729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040be83-185f-4014-ac8e-1984ac3c4ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:09.281497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040be83-185f-4014-ac8e-1984ac3c4ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:09.283465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040be83-185f-4014-ac8e-1984ac3c4ff5 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:09.308821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1044/2099] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:09 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:09.312462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2735a9-827f-4416-99a4-2d281467c36e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:09.330214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2735a9-827f-4416-99a4-2d281467c36e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:09.337133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b555d-d3f2-423d-811d-f76489484ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:09.338138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b555d-d3f2-423d-811d-f76489484ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:09.338844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b555d-d3f2-423d-811d-f76489484ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:09.339270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b555d-d3f2-423d-811d-f76489484ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:09.341047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b555d-d3f2-423d-811d-f76489484ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:09.344013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b555d-d3f2-423d-811d-f76489484ce5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:09.360812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1056/2100] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:09.364561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040be83-185f-4014-ac8e-1984ac3c4ff5 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:09.375529 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040be83-185f-4014-ac8e-1984ac3c4ff5 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:09.382338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7546-53e7-4cb3-b24d-f0cb1ed934be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:09.383433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7546-53e7-4cb3-b24d-f0cb1ed934be admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:09.383716 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7546-53e7-4cb3-b24d-f0cb1ed934be admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:09.383991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7546-53e7-4cb3-b24d-f0cb1ed934be admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:09.384837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db7546-53e7-4cb3-b24d-f0cb1ed934be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:09.386510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db7546-53e7-4cb3-b24d-f0cb1ed934be admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:09.398135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1045/2101] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:09.402889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b555d-d3f2-423d-811d-f76489484ce5 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:09.431810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b555d-d3f2-423d-811d-f76489484ce5 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:09.437719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a3855-091d-4032-9cad-1f16b31ba355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:09.438993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3855-091d-4032-9cad-1f16b31ba355 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:09.440096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3855-091d-4032-9cad-1f16b31ba355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:09.440562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3855-091d-4032-9cad-1f16b31ba355 admin admin] PATH_INFO: `/v3/projects/931be1ad5b8e41b58efdc92a30400053/users/5d2f15f8b9a142758a76f057e07c0856/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:09.474617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a3855-091d-4032-9cad-1f16b31ba355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=931be1ad5b8e41b58efdc92a30400053, user_id=5d2f15f8b9a142758a76f057e07c0856, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:09.478838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a3855-091d-4032-9cad-1f16b31ba355 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:09.504009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1057/2102] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:09 2022] PUT /identity/v3/projects/931be1ad5b8e41b58efdc92a30400053/users/5d2f15f8b9a142758a76f057e07c0856/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:09.515549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ef0f8-7a1c-4486-ab2f-e3626bb613c8 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:09.515846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ef0f8-7a1c-4486-ab2f-e3626bb613c8 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:09.516119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ef0f8-7a1c-4486-ab2f-e3626bb613c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:09.549704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-101ef0f8-7a1c-4486-ab2f-e3626bb613c8 None None] MFA Rules not processed for user `5d2f15f8b9a142758a76f057e07c0856`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:09.551289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-101ef0f8-7a1c-4486-ab2f-e3626bb613c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:09.683390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1046/2103] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:09.684578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a3855-091d-4032-9cad-1f16b31ba355 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:09.767679 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c5b00-0b7f-44a8-bb8e-0e711d572502 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:09.767956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c5b00-0b7f-44a8-bb8e-0e711d572502 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:09.768226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c5b00-0b7f-44a8-bb8e-0e711d572502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:09.789659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-f47c5b00-0b7f-44a8-bb8e-0e711d572502 None None] MFA Rules not processed for user `8c6f7ac9ef024f70bbc74961b4b7b7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:09.791206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f47c5b00-0b7f-44a8-bb8e-0e711d572502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:09.831777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a3855-091d-4032-9cad-1f16b31ba355 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:09.837907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8c2e6-c5c1-4842-84f2-39a70f7d427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:09.839438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8c2e6-c5c1-4842-84f2-39a70f7d427e admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:09.840320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8c2e6-c5c1-4842-84f2-39a70f7d427e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:09.840671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8c2e6-c5c1-4842-84f2-39a70f7d427e admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:09.841491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8c2e6-c5c1-4842-84f2-39a70f7d427e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:09.844541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8c2e6-c5c1-4842-84f2-39a70f7d427e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:09.874720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1047/2104] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:09.896996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1058/2105] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:09 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:09.900168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c5b00-0b7f-44a8-bb8e-0e711d572502 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:09.910923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c5b00-0b7f-44a8-bb8e-0e711d572502 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:09.986479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c2691-f17a-433a-b164-a61d06f6ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:09.987266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2691-f17a-433a-b164-a61d06f6ad3a admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:09.987630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2691-f17a-433a-b164-a61d06f6ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:09.988013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2691-f17a-433a-b164-a61d06f6ad3a admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:09.988970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c2691-f17a-433a-b164-a61d06f6ad3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:09.991269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c2691-f17a-433a-b164-a61d06f6ad3a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:10.032759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1048/2106] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:09 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:10.039595 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8c2e6-c5c1-4842-84f2-39a70f7d427e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:10.053543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8c2e6-c5c1-4842-84f2-39a70f7d427e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:10.074424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993636f-3fea-4f67-bbb8-5c0e51ffec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:10.075302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993636f-3fea-4f67-bbb8-5c0e51ffec4f admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.076292 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993636f-3fea-4f67-bbb8-5c0e51ffec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.076662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993636f-3fea-4f67-bbb8-5c0e51ffec4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.077819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993636f-3fea-4f67-bbb8-5c0e51ffec4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:10.080763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993636f-3fea-4f67-bbb8-5c0e51ffec4f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:10.095767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1059/2107] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:10.100093 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c2691-f17a-433a-b164-a61d06f6ad3a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:10.111551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c2691-f17a-433a-b164-a61d06f6ad3a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:10.117332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146227-c6f0-4082-8ada-7d6194643650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:10.118355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146227-c6f0-4082-8ada-7d6194643650 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.118737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146227-c6f0-4082-8ada-7d6194643650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.119067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146227-c6f0-4082-8ada-7d6194643650 admin admin] PATH_INFO: `/v3/projects/d8ff6255c6f64e289e38a81b5052748c/users/9326c0d51efe40948334a7aa4b12a7f5/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.137401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15146227-c6f0-4082-8ada-7d6194643650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ff6255c6f64e289e38a81b5052748c, user_id=9326c0d51efe40948334a7aa4b12a7f5, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:10.140263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15146227-c6f0-4082-8ada-7d6194643650 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:10.155238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1049/2108] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:10 2022] PUT /identity/v3/projects/d8ff6255c6f64e289e38a81b5052748c/users/9326c0d51efe40948334a7aa4b12a7f5/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:58:10.159682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993636f-3fea-4f67-bbb8-5c0e51ffec4f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:10.171931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993636f-3fea-4f67-bbb8-5c0e51ffec4f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:10.257933 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d37b-cc58-450a-8e40-caf6df36cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:10.258633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d37b-cc58-450a-8e40-caf6df36cade admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.258924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d37b-cc58-450a-8e40-caf6df36cade admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.259232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d37b-cc58-450a-8e40-caf6df36cade admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.260016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568d37b-cc58-450a-8e40-caf6df36cade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:10.262278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568d37b-cc58-450a-8e40-caf6df36cade admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:10.275651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1060/2109] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:10.279859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146227-c6f0-4082-8ada-7d6194643650 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:10.294077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146227-c6f0-4082-8ada-7d6194643650 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:10.321598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c7180-8962-4338-882d-ad9c9a9e411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:10.322562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c7180-8962-4338-882d-ad9c9a9e411c admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.322837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c7180-8962-4338-882d-ad9c9a9e411c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.323106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c7180-8962-4338-882d-ad9c9a9e411c admin admin] PATH_INFO: `/v3/projects/d8ff6255c6f64e289e38a81b5052748c/users/9326c0d51efe40948334a7aa4b12a7f5/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.326219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c7180-8962-4338-882d-ad9c9a9e411c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ff6255c6f64e289e38a81b5052748c, user_id=9326c0d51efe40948334a7aa4b12a7f5, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:10.330091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c7180-8962-4338-882d-ad9c9a9e411c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:10.342934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1050/2110] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:10 2022] PUT /identity/v3/projects/d8ff6255c6f64e289e38a81b5052748c/users/9326c0d51efe40948334a7aa4b12a7f5/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:10.356858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f459-8682-4575-854b-4a8e75af07f4 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.357173 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f459-8682-4575-854b-4a8e75af07f4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.357450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f459-8682-4575-854b-4a8e75af07f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.388221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a7a4f459-8682-4575-854b-4a8e75af07f4 None None] MFA Rules not processed for user `9326c0d51efe40948334a7aa4b12a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:10.389684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a7a4f459-8682-4575-854b-4a8e75af07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:10.505223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1061/2111] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:10.517726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c7180-8962-4338-882d-ad9c9a9e411c admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:10.519981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d07c7180-8962-4338-882d-ad9c9a9e411c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:10.606812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c7180-8962-4338-882d-ad9c9a9e411c admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:10.610824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dde7a-99f5-4004-9905-efb0f44daec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:10.611592 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dde7a-99f5-4004-9905-efb0f44daec5 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.611939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dde7a-99f5-4004-9905-efb0f44daec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.612301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dde7a-99f5-4004-9905-efb0f44daec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.633054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dde7a-99f5-4004-9905-efb0f44daec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:10.634295 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dde7a-99f5-4004-9905-efb0f44daec5 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:10.644861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1051/2112] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:10.704763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4f459-8682-4575-854b-4a8e75af07f4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:10.706611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a7a4f459-8682-4575-854b-4a8e75af07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:10.740464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4f459-8682-4575-854b-4a8e75af07f4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:10.747196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0648f-3dbf-43dd-a18d-26a6dc8c5962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:10.747886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0648f-3dbf-43dd-a18d-26a6dc8c5962 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:10.748873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0648f-3dbf-43dd-a18d-26a6dc8c5962 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:10.749162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0648f-3dbf-43dd-a18d-26a6dc8c5962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:10.893683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0648f-3dbf-43dd-a18d-26a6dc8c5962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:10.895638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0648f-3dbf-43dd-a18d-26a6dc8c5962 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:10.907159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1062/2113] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:11.136491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dde7a-99f5-4004-9905-efb0f44daec5 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:11.139412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-866dde7a-99f5-4004-9905-efb0f44daec5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:11.239621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dde7a-99f5-4004-9905-efb0f44daec5 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:11.247358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:11.248607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:11.249041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:11.249184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] PATH_INFO: `/v3/users/07917c077f9b483da4db0e157f1357db` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:11.251770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07917c077f9b483da4db0e157f1357db)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:11.253449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:11.315549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07917c077f9b483da4db0e157f1357db'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:11.326246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07917c077f9b483da4db0e157f1357db'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:11.327227 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07917c077f9b483da4db0e157f1357db'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:11.327883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07917c077f9b483da4db0e157f1357db'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:11.343657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07917c077f9b483da4db0e157f1357db'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:11.388764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1052/2114] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:11 2022] DELETE /identity/v3/users/07917c077f9b483da4db0e157f1357db => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:11.393590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4069ca0-c03d-4f9b-a460-7fee2ea517ab None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:11.394110 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4069ca0-c03d-4f9b-a460-7fee2ea517ab None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:11.394187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4069ca0-c03d-4f9b-a460-7fee2ea517ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:11.416469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a4069ca0-c03d-4f9b-a460-7fee2ea517ab None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:11.417749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a4069ca0-c03d-4f9b-a460-7fee2ea517ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:11.480366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1063/2115] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:11.490898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:11.492387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:11.563000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680875c4-1b2e-4371-a663-d31d0b420e21 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:11.566782 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17e01b-e229-443f-8924-ac9f295e6c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:11.567461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17e01b-e229-443f-8924-ac9f295e6c62 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:11.567780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17e01b-e229-443f-8924-ac9f295e6c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:11.568006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17e01b-e229-443f-8924-ac9f295e6c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:11.577639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17e01b-e229-443f-8924-ac9f295e6c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:11.579075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17e01b-e229-443f-8924-ac9f295e6c62 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:11.594419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1053/2116] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:11.971369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4069ca0-c03d-4f9b-a460-7fee2ea517ab None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:11.973088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a4069ca0-c03d-4f9b-a460-7fee2ea517ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:11.987470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4069ca0-c03d-4f9b-a460-7fee2ea517ab None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:11.993709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:12.001491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.001977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.002405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] PATH_INFO: `/v3/projects/41f1ef9bf4694b7fa292fbd6caaf9c28` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.004446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f1ef9bf4694b7fa292fbd6caaf9c28)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:12.006596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:12.103808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f1ef9bf4694b7fa292fbd6caaf9c28', 'request_id': 'req-38a3cab6-2087-44f9-bf47-2cab6de0893e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:12.113700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f1ef9bf4694b7fa292fbd6caaf9c28', 'request_id': 'req-38a3cab6-2087-44f9-bf47-2cab6de0893e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:12.121132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f1ef9bf4694b7fa292fbd6caaf9c28', 'request_id': 'req-38a3cab6-2087-44f9-bf47-2cab6de0893e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:12.132867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] The token cache is being invalidate because project 41f1ef9bf4694b7fa292fbd6caaf9c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:12.133210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:12.134016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-38a3cab6-2087-44f9-bf47-2cab6de0893e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:12.135746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1064/2117] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:11 2022] DELETE /identity/v3/projects/41f1ef9bf4694b7fa292fbd6caaf9c28 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:12.141333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73cca-c3bc-47ef-8893-6965876b8c06 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.141623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73cca-c3bc-47ef-8893-6965876b8c06 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.141903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73cca-c3bc-47ef-8893-6965876b8c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.169858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-06d73cca-c3bc-47ef-8893-6965876b8c06 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:12.171102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-06d73cca-c3bc-47ef-8893-6965876b8c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:12.234030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1054/2118] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:12.241660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c2b0a-0701-470e-a0ea-df57210853ed None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.241940 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c2b0a-0701-470e-a0ea-df57210853ed None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.242217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c2b0a-0701-470e-a0ea-df57210853ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.260986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-cf9c2b0a-0701-470e-a0ea-df57210853ed None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:12.262206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cf9c2b0a-0701-470e-a0ea-df57210853ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:12.273313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1065/2119] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:12.278888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d73cca-c3bc-47ef-8893-6965876b8c06 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:12.289376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d73cca-c3bc-47ef-8893-6965876b8c06 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:12.295043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450f1f0-229f-469c-9ceb-79b829a131e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:12.295727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450f1f0-229f-469c-9ceb-79b829a131e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.296010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450f1f0-229f-469c-9ceb-79b829a131e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.296285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450f1f0-229f-469c-9ceb-79b829a131e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.297032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450f1f0-229f-469c-9ceb-79b829a131e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:12.297360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450f1f0-229f-469c-9ceb-79b829a131e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:12.299034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450f1f0-229f-469c-9ceb-79b829a131e8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:12.311163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1055/2120] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:58:12.315760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c2b0a-0701-470e-a0ea-df57210853ed None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:12.324921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c2b0a-0701-470e-a0ea-df57210853ed None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:12.329686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bee5e2-ce87-4f68-9aad-7d1b8e22da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:12.330373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bee5e2-ce87-4f68-9aad-7d1b8e22da09 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.330703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bee5e2-ce87-4f68-9aad-7d1b8e22da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.330981 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bee5e2-ce87-4f68-9aad-7d1b8e22da09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.331687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bee5e2-ce87-4f68-9aad-7d1b8e22da09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:12.333609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bee5e2-ce87-4f68-9aad-7d1b8e22da09 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:12.363762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1066/2121] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:12 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:58:12.368229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450f1f0-229f-469c-9ceb-79b829a131e8 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:12.379226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450f1f0-229f-469c-9ceb-79b829a131e8 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:12.451460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7a29e-f5ca-4457-963e-3e37b663dd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:12.452928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7a29e-f5ca-4457-963e-3e37b663dd21 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.453724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7a29e-f5ca-4457-963e-3e37b663dd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.454125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7a29e-f5ca-4457-963e-3e37b663dd21 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.454907 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7a29e-f5ca-4457-963e-3e37b663dd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:12.458278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7a29e-f5ca-4457-963e-3e37b663dd21 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:12.493325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1056/2122] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:12 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:12.495733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bee5e2-ce87-4f68-9aad-7d1b8e22da09 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:12.506146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bee5e2-ce87-4f68-9aad-7d1b8e22da09 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:12.511009 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d8a18-9fa5-4d1e-8477-7c2a07f4ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:12.511683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d8a18-9fa5-4d1e-8477-7c2a07f4ef9b admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.511956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d8a18-9fa5-4d1e-8477-7c2a07f4ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.512224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d8a18-9fa5-4d1e-8477-7c2a07f4ef9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.513136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d8a18-9fa5-4d1e-8477-7c2a07f4ef9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:12.514784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d8a18-9fa5-4d1e-8477-7c2a07f4ef9b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:12.525700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1067/2123] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:58:12.529967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7a29e-f5ca-4457-963e-3e37b663dd21 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:12.543736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7a29e-f5ca-4457-963e-3e37b663dd21 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:12.553651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b502a5-ae94-4a50-819a-07cd9dfd04ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:12.554348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b502a5-ae94-4a50-819a-07cd9dfd04ac admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.554623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b502a5-ae94-4a50-819a-07cd9dfd04ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.554896 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b502a5-ae94-4a50-819a-07cd9dfd04ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.555641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b502a5-ae94-4a50-819a-07cd9dfd04ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:12.557364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b502a5-ae94-4a50-819a-07cd9dfd04ac admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:12.570066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1057/2124] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:58:12.574156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d8a18-9fa5-4d1e-8477-7c2a07f4ef9b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:12.584249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d8a18-9fa5-4d1e-8477-7c2a07f4ef9b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:12.589073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57274ed2-7457-4161-8f30-529dbe530b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:12.590086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57274ed2-7457-4161-8f30-529dbe530b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.590428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57274ed2-7457-4161-8f30-529dbe530b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.590839 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57274ed2-7457-4161-8f30-529dbe530b37 admin admin] PATH_INFO: `/v3/projects/648aeb6cd9384a51b759fe4fed0586a4/users/b59093d4f76e4fdabe8e41440cf31f32/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.614039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57274ed2-7457-4161-8f30-529dbe530b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648aeb6cd9384a51b759fe4fed0586a4, user_id=b59093d4f76e4fdabe8e41440cf31f32, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:12.617098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57274ed2-7457-4161-8f30-529dbe530b37 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:12.632597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1068/2125] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:12 2022] PUT /identity/v3/projects/648aeb6cd9384a51b759fe4fed0586a4/users/b59093d4f76e4fdabe8e41440cf31f32/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:12.637969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f799472-9e49-4078-9711-2b095a33132c None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.638336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f799472-9e49-4078-9711-2b095a33132c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.638546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f799472-9e49-4078-9711-2b095a33132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.659189 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-6f799472-9e49-4078-9711-2b095a33132c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:12.660721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6f799472-9e49-4078-9711-2b095a33132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:12.737246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1058/2126] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:12.746329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57274ed2-7457-4161-8f30-529dbe530b37 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:12.748940 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-57274ed2-7457-4161-8f30-529dbe530b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:12.821201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57274ed2-7457-4161-8f30-529dbe530b37 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:12.825666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d8be-291e-4043-b7aa-d8a5ce533c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:12.826384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d8be-291e-4043-b7aa-d8a5ce533c66 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:12.826669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d8be-291e-4043-b7aa-d8a5ce533c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:12.826944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d8be-291e-4043-b7aa-d8a5ce533c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:12.839415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531d8be-291e-4043-b7aa-d8a5ce533c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:12.841407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531d8be-291e-4043-b7aa-d8a5ce533c66 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:12.861030 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1069/2127] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:13.744862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a2906-fcaf-4a4a-8e03-2dd8ca681467 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:13.745417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a2906-fcaf-4a4a-8e03-2dd8ca681467 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:13.745680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a2906-fcaf-4a4a-8e03-2dd8ca681467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:13.786965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7e3a2906-fcaf-4a4a-8e03-2dd8ca681467 None None] MFA Rules not processed for user `b59093d4f76e4fdabe8e41440cf31f32`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:13.788212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7e3a2906-fcaf-4a4a-8e03-2dd8ca681467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:13.875918 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1059/2128] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:13.889575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d8be-291e-4043-b7aa-d8a5ce533c66 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:13.891632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4531d8be-291e-4043-b7aa-d8a5ce533c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:13.973932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d8be-291e-4043-b7aa-d8a5ce533c66 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:13.978475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f8386-083c-4ea5-82cd-96146f3331ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:13.979415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f8386-083c-4ea5-82cd-96146f3331ee service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:13.980031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f8386-083c-4ea5-82cd-96146f3331ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:13.980546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f8386-083c-4ea5-82cd-96146f3331ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:13.999740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f8386-083c-4ea5-82cd-96146f3331ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:14.001462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f8386-083c-4ea5-82cd-96146f3331ee service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:14.028439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1070/2129] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:14.102005 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a2906-fcaf-4a4a-8e03-2dd8ca681467 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:14.104112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7e3a2906-fcaf-4a4a-8e03-2dd8ca681467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:14.124444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a2906-fcaf-4a4a-8e03-2dd8ca681467 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:14.134864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:14.136111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:14.136471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:14.136757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] PATH_INFO: `/v3/users/1710cdcea49942b7870e6a04e1190505` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:14.138147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1710cdcea49942b7870e6a04e1190505)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:14.140960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:14.219835 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1710cdcea49942b7870e6a04e1190505'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:14.238313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1710cdcea49942b7870e6a04e1190505'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:14.239227 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1710cdcea49942b7870e6a04e1190505'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:14.239969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1710cdcea49942b7870e6a04e1190505'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:14.251205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1710cdcea49942b7870e6a04e1190505'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:14.273104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1060/2130] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:14 2022] DELETE /identity/v3/users/1710cdcea49942b7870e6a04e1190505 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:14.278612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f8542-7b8f-4285-9b3c-d8e543e1159f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:14.278907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f8542-7b8f-4285-9b3c-d8e543e1159f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:14.279339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f8542-7b8f-4285-9b3c-d8e543e1159f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:14.306902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-806f8542-7b8f-4285-9b3c-d8e543e1159f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:14.308589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-806f8542-7b8f-4285-9b3c-d8e543e1159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:14.410934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1071/2131] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:14.422708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:14.424431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:14.534386 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b2ce-f34b-4d6f-a606-c8177fdc532a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:14.538855 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b9ea-3d35-44e2-9c8e-4b610f6a3360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:14.539701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b9ea-3d35-44e2-9c8e-4b610f6a3360 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:14.540493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b9ea-3d35-44e2-9c8e-4b610f6a3360 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:14.540957 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b9ea-3d35-44e2-9c8e-4b610f6a3360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:14.555522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9b9ea-3d35-44e2-9c8e-4b610f6a3360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:14.557368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9b9ea-3d35-44e2-9c8e-4b610f6a3360 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:14.571871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1061/2132] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:15.165075 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f8542-7b8f-4285-9b3c-d8e543e1159f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:15.167856 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-806f8542-7b8f-4285-9b3c-d8e543e1159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:15.180921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f8542-7b8f-4285-9b3c-d8e543e1159f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:15.192032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:15.193454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:15.193549 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:15.193857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] PATH_INFO: `/v3/projects/abf6a135bf824df98f43ee4f986e945e` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:15.195160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf6a135bf824df98f43ee4f986e945e)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:15.197256 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:15.248352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf6a135bf824df98f43ee4f986e945e', 'request_id': 'req-5f567078-4aa0-4157-a8cc-16ad6cc89d07'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.256781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf6a135bf824df98f43ee4f986e945e', 'request_id': 'req-5f567078-4aa0-4157-a8cc-16ad6cc89d07'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.262955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf6a135bf824df98f43ee4f986e945e', 'request_id': 'req-5f567078-4aa0-4157-a8cc-16ad6cc89d07'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.273543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] The token cache is being invalidate because project abf6a135bf824df98f43ee4f986e945e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:15.273836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.274483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5f567078-4aa0-4157-a8cc-16ad6cc89d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.276058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1072/2133] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:15 2022] DELETE /identity/v3/projects/abf6a135bf824df98f43ee4f986e945e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:15.280306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b9ea-3d35-44e2-9c8e-4b610f6a3360 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:15.290001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b9ea-3d35-44e2-9c8e-4b610f6a3360 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:15.348222 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:15.349109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:15.349450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:15.349777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] PATH_INFO: `/v3/users/5d2f15f8b9a142758a76f057e07c0856` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:15.351217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2f15f8b9a142758a76f057e07c0856)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:15.353251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:15.406362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2f15f8b9a142758a76f057e07c0856'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.414410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2f15f8b9a142758a76f057e07c0856'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.415196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2f15f8b9a142758a76f057e07c0856'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.415943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2f15f8b9a142758a76f057e07c0856'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.426188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2f15f8b9a142758a76f057e07c0856'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.444610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1062/2134] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:15 2022] DELETE /identity/v3/users/5d2f15f8b9a142758a76f057e07c0856 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:15.567046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5a0af-cce6-4f6f-9eb2-e6a0251e633b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:15.567412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5a0af-cce6-4f6f-9eb2-e6a0251e633b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:15.567761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5a0af-cce6-4f6f-9eb2-e6a0251e633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:15.590812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-95d5a0af-cce6-4f6f-9eb2-e6a0251e633b None None] MFA Rules not processed for user `b59093d4f76e4fdabe8e41440cf31f32`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:15.592085 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-95d5a0af-cce6-4f6f-9eb2-e6a0251e633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:15.655548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1073/2135] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:15.795584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:15.797176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:15.899393 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefc89b-a0c0-4550-9074-d4e950580b0e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:15.906777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:15.907662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:15.907947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:15.908220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] PATH_INFO: `/v3/projects/931be1ad5b8e41b58efdc92a30400053` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:15.909436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=931be1ad5b8e41b58efdc92a30400053)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:15.911362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:15.971304 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931be1ad5b8e41b58efdc92a30400053', 'request_id': 'req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.977945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931be1ad5b8e41b58efdc92a30400053', 'request_id': 'req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:15.988354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931be1ad5b8e41b58efdc92a30400053', 'request_id': 'req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.001074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] The token cache is being invalidate because project 931be1ad5b8e41b58efdc92a30400053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:16.001401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.002056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.003632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1063/2136] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:15 2022] DELETE /identity/v3/projects/931be1ad5b8e41b58efdc92a30400053 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:16.007602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5a0af-cce6-4f6f-9eb2-e6a0251e633b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:16.019220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5a0af-cce6-4f6f-9eb2-e6a0251e633b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:16.073902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:16.074788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:16.075062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:16.075332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] PATH_INFO: `/v3/users/9326c0d51efe40948334a7aa4b12a7f5` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:16.076505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9326c0d51efe40948334a7aa4b12a7f5)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:16.078462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:16.128126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9326c0d51efe40948334a7aa4b12a7f5'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.135310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9326c0d51efe40948334a7aa4b12a7f5'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.136067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9326c0d51efe40948334a7aa4b12a7f5'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.136712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9326c0d51efe40948334a7aa4b12a7f5'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.149275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-de48938a-4e6e-45d9-940e-336cf1baeeab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9326c0d51efe40948334a7aa4b12a7f5'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.168677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1074/2137] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:16 2022] DELETE /identity/v3/users/9326c0d51efe40948334a7aa4b12a7f5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:16.499059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:16.500855 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:16.516207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbd5c3-fcf1-44a1-bec8-74364a867c1d admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:16.574441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:16.575353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:16.575636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:16.575914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] PATH_INFO: `/v3/projects/d8ff6255c6f64e289e38a81b5052748c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:16.577088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ff6255c6f64e289e38a81b5052748c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:16.579034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:16.624289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ff6255c6f64e289e38a81b5052748c', 'request_id': 'req-89b4ad1b-fb4a-450b-8e3e-371922463cbe'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.630102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ff6255c6f64e289e38a81b5052748c', 'request_id': 'req-89b4ad1b-fb4a-450b-8e3e-371922463cbe'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.638650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ff6255c6f64e289e38a81b5052748c', 'request_id': 'req-89b4ad1b-fb4a-450b-8e3e-371922463cbe'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.648618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] The token cache is being invalidate because project d8ff6255c6f64e289e38a81b5052748c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:16.648928 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.649629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-89b4ad1b-fb4a-450b-8e3e-371922463cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:16.651396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1064/2138] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:16 2022] DELETE /identity/v3/projects/d8ff6255c6f64e289e38a81b5052748c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:16.657358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f8d9f-7dff-4a68-8187-17c8ba64654f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:16.657643 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f8d9f-7dff-4a68-8187-17c8ba64654f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:16.657942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f8d9f-7dff-4a68-8187-17c8ba64654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:16.675815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-574f8d9f-7dff-4a68-8187-17c8ba64654f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:16.677016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-574f8d9f-7dff-4a68-8187-17c8ba64654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:16.748297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1075/2139] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:16.758375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6bd7-6b38-42ca-8981-3cc1b824f67a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:16.758657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6bd7-6b38-42ca-8981-3cc1b824f67a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:16.758963 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6bd7-6b38-42ca-8981-3cc1b824f67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:16.778789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c4bc6bd7-6b38-42ca-8981-3cc1b824f67a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:16.779975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c4bc6bd7-6b38-42ca-8981-3cc1b824f67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:16.788813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1065/2140] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:16.793413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f8d9f-7dff-4a68-8187-17c8ba64654f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:16.803139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f8d9f-7dff-4a68-8187-17c8ba64654f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:16.808393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf9b9d-0695-434d-a7f2-1447b28d6eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:16.809051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf9b9d-0695-434d-a7f2-1447b28d6eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:16.809366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf9b9d-0695-434d-a7f2-1447b28d6eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:16.809644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf9b9d-0695-434d-a7f2-1447b28d6eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:16.810381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf9b9d-0695-434d-a7f2-1447b28d6eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:16.810690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf9b9d-0695-434d-a7f2-1447b28d6eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:16.812295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf9b9d-0695-434d-a7f2-1447b28d6eb7 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:16.824230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1076/2141] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:58:16.828542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc6bd7-6b38-42ca-8981-3cc1b824f67a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:16.837983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc6bd7-6b38-42ca-8981-3cc1b824f67a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:16.843010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd38730-ee92-4e71-a35f-5005ef5e97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:16.843656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd38730-ee92-4e71-a35f-5005ef5e97fc admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:16.843936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd38730-ee92-4e71-a35f-5005ef5e97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:16.844209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd38730-ee92-4e71-a35f-5005ef5e97fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:16.844927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd38730-ee92-4e71-a35f-5005ef5e97fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:16.846885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd38730-ee92-4e71-a35f-5005ef5e97fc admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:16.874079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1066/2142] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:58:16.879215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf9b9d-0695-434d-a7f2-1447b28d6eb7 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:16.889148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf9b9d-0695-434d-a7f2-1447b28d6eb7 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:16.944922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21095-a8fc-461c-bf9e-36516eadc340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:16.945738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21095-a8fc-461c-bf9e-36516eadc340 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:16.946022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21095-a8fc-461c-bf9e-36516eadc340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:16.946294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21095-a8fc-461c-bf9e-36516eadc340 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:16.947042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b21095-a8fc-461c-bf9e-36516eadc340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:16.949195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b21095-a8fc-461c-bf9e-36516eadc340 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:16.969766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1077/2143] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:16 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:58:16.973759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd38730-ee92-4e71-a35f-5005ef5e97fc admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:16.983712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd38730-ee92-4e71-a35f-5005ef5e97fc admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:16.988556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb3821-f70b-4750-ac00-07a43d953c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:16.989220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb3821-f70b-4750-ac00-07a43d953c74 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:16.989529 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb3821-f70b-4750-ac00-07a43d953c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:16.989828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb3821-f70b-4750-ac00-07a43d953c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:16.990520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb3821-f70b-4750-ac00-07a43d953c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:16.992247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb3821-f70b-4750-ac00-07a43d953c74 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:17.003570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1067/2144] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:17.010170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21095-a8fc-461c-bf9e-36516eadc340 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:17.020230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21095-a8fc-461c-bf9e-36516eadc340 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:17.025098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b282ba3-5708-4cd4-8899-6d0456b6b36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:17.025801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b282ba3-5708-4cd4-8899-6d0456b6b36f admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:17.026052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b282ba3-5708-4cd4-8899-6d0456b6b36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:17.026328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b282ba3-5708-4cd4-8899-6d0456b6b36f admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:17.027092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b282ba3-5708-4cd4-8899-6d0456b6b36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:17.028703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b282ba3-5708-4cd4-8899-6d0456b6b36f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:17.038842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1078/2145] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:17.043287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb3821-f70b-4750-ac00-07a43d953c74 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:17.053210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb3821-f70b-4750-ac00-07a43d953c74 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:17.058261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde67f25-f463-4afb-a085-755a59d72039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:17.059147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde67f25-f463-4afb-a085-755a59d72039 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:17.059426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde67f25-f463-4afb-a085-755a59d72039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:17.059695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde67f25-f463-4afb-a085-755a59d72039 admin admin] PATH_INFO: `/v3/projects/49d7452f54af4a58b021417f8afff3f6/users/2bab9f781a9646fa8e3028e82b676a24/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:17.074298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde67f25-f463-4afb-a085-755a59d72039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d7452f54af4a58b021417f8afff3f6, user_id=2bab9f781a9646fa8e3028e82b676a24, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:17.076940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde67f25-f463-4afb-a085-755a59d72039 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:17.090250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1068/2146] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:17 2022] PUT /identity/v3/projects/49d7452f54af4a58b021417f8afff3f6/users/2bab9f781a9646fa8e3028e82b676a24/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:17.101803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6d36-97a2-4cd1-bb50-9caab2c700ec None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:17.102095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6d36-97a2-4cd1-bb50-9caab2c700ec None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:17.102376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6d36-97a2-4cd1-bb50-9caab2c700ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:17.129145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-809b6d36-97a2-4cd1-bb50-9caab2c700ec None None] MFA Rules not processed for user `2bab9f781a9646fa8e3028e82b676a24`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:17.130477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-809b6d36-97a2-4cd1-bb50-9caab2c700ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:17.194364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1079/2147] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:17.205698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde67f25-f463-4afb-a085-755a59d72039 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:17.207475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-dde67f25-f463-4afb-a085-755a59d72039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:17.261717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde67f25-f463-4afb-a085-755a59d72039 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:17.265427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d065-072c-4668-bb67-4166e1664700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:17.266074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d065-072c-4668-bb67-4166e1664700 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:17.266354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d065-072c-4668-bb67-4166e1664700 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:17.266627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d065-072c-4668-bb67-4166e1664700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:17.274943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36d065-072c-4668-bb67-4166e1664700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:17.276375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36d065-072c-4668-bb67-4166e1664700 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:17.285575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1069/2148] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:21.379470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b6d36-97a2-4cd1-bb50-9caab2c700ec None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:21.444836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b6d36-97a2-4cd1-bb50-9caab2c700ec None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:21.450938 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:21.452432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:21.452881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:21.453329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] PATH_INFO: `/v3/users/2bab9f781a9646fa8e3028e82b676a24` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:21.462056 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bab9f781a9646fa8e3028e82b676a24)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:21.465048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:21.529210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bab9f781a9646fa8e3028e82b676a24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:21.536287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bab9f781a9646fa8e3028e82b676a24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:21.537054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bab9f781a9646fa8e3028e82b676a24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:21.537825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bab9f781a9646fa8e3028e82b676a24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:21.547239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bab9f781a9646fa8e3028e82b676a24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:21.567544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1080/2149] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:21 2022] DELETE /identity/v3/users/2bab9f781a9646fa8e3028e82b676a24 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:21.572322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972d14-92b8-41ec-864e-c23cfe3fbe45 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:21.572898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972d14-92b8-41ec-864e-c23cfe3fbe45 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:21.573002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972d14-92b8-41ec-864e-c23cfe3fbe45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:21.602265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-28972d14-92b8-41ec-864e-c23cfe3fbe45 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:21.604154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-28972d14-92b8-41ec-864e-c23cfe3fbe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:21.670139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1070/2150] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:21.681122 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:21.683557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:21.750997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288e1f8-b141-437e-9077-67da2b0bce44 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:21.754632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ee12e-83be-4107-8cae-6731682cc8ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:21.755266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee12e-83be-4107-8cae-6731682cc8ba service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:21.755547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee12e-83be-4107-8cae-6731682cc8ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:21.755818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee12e-83be-4107-8cae-6731682cc8ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:21.764873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ee12e-83be-4107-8cae-6731682cc8ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:21.766350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ee12e-83be-4107-8cae-6731682cc8ba service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:21.776070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1081/2151] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:22.137759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972d14-92b8-41ec-864e-c23cfe3fbe45 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:22.139284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-28972d14-92b8-41ec-864e-c23cfe3fbe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:22.151318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972d14-92b8-41ec-864e-c23cfe3fbe45 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:22.156824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:22.157778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.157996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.158460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] PATH_INFO: `/v3/projects/49d7452f54af4a58b021417f8afff3f6` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.159662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d7452f54af4a58b021417f8afff3f6)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:22.161638 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:22.219091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d7452f54af4a58b021417f8afff3f6', 'request_id': 'req-63ba79a5-49c0-4161-9c94-10aa80bc9b11'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:22.227420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d7452f54af4a58b021417f8afff3f6', 'request_id': 'req-63ba79a5-49c0-4161-9c94-10aa80bc9b11'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:22.236288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d7452f54af4a58b021417f8afff3f6', 'request_id': 'req-63ba79a5-49c0-4161-9c94-10aa80bc9b11'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:22.246939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] The token cache is being invalidate because project 49d7452f54af4a58b021417f8afff3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:22.247221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:22.247843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-63ba79a5-49c0-4161-9c94-10aa80bc9b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:22.249454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1071/2152] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:22 2022] DELETE /identity/v3/projects/49d7452f54af4a58b021417f8afff3f6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:58:22.254405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20070d37-cbaa-4071-a364-ee524856427c None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.254686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20070d37-cbaa-4071-a364-ee524856427c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.254977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20070d37-cbaa-4071-a364-ee524856427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.272569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-20070d37-cbaa-4071-a364-ee524856427c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:22.273789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-20070d37-cbaa-4071-a364-ee524856427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:22.342870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1082/2153] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:22.350900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d117cb-b646-4820-8239-aad0a150bcfc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.351194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d117cb-b646-4820-8239-aad0a150bcfc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.351490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d117cb-b646-4820-8239-aad0a150bcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.371808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-f6d117cb-b646-4820-8239-aad0a150bcfc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:22.373011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f6d117cb-b646-4820-8239-aad0a150bcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:22.382782 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1072/2154] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:22.387040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20070d37-cbaa-4071-a364-ee524856427c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:22.400838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20070d37-cbaa-4071-a364-ee524856427c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:22.405574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047017c-87a3-4199-a77c-5bf00c5a989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:22.406231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047017c-87a3-4199-a77c-5bf00c5a989e admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.406514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047017c-87a3-4199-a77c-5bf00c5a989e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.406789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047017c-87a3-4199-a77c-5bf00c5a989e admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.407519 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047017c-87a3-4199-a77c-5bf00c5a989e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:22.407828 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047017c-87a3-4199-a77c-5bf00c5a989e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:22.409452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047017c-87a3-4199-a77c-5bf00c5a989e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:22.421065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1083/2155] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:58:22.425334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d117cb-b646-4820-8239-aad0a150bcfc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:22.434418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d117cb-b646-4820-8239-aad0a150bcfc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:22.439443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37c7df-144d-44e6-9a9c-06667a8f6818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:22.440090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c7df-144d-44e6-9a9c-06667a8f6818 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.440367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c7df-144d-44e6-9a9c-06667a8f6818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.440610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c7df-144d-44e6-9a9c-06667a8f6818 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.441337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37c7df-144d-44e6-9a9c-06667a8f6818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:22.443266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37c7df-144d-44e6-9a9c-06667a8f6818 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:22.472312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1073/2156] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:22 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:22.476512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047017c-87a3-4199-a77c-5bf00c5a989e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:22.486902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047017c-87a3-4199-a77c-5bf00c5a989e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:22.542572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16a727-d8a7-43e9-bb32-95ebff5375aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:22.543246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16a727-d8a7-43e9-bb32-95ebff5375aa admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.543523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16a727-d8a7-43e9-bb32-95ebff5375aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.543793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16a727-d8a7-43e9-bb32-95ebff5375aa admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.544479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16a727-d8a7-43e9-bb32-95ebff5375aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:22.546424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16a727-d8a7-43e9-bb32-95ebff5375aa admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:22.568758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1084/2157] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:22 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:22.572982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37c7df-144d-44e6-9a9c-06667a8f6818 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:22.583705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37c7df-144d-44e6-9a9c-06667a8f6818 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:22.588849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca0d6-f5fc-4d96-bddc-d92ae04e67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:22.589624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca0d6-f5fc-4d96-bddc-d92ae04e67bf admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.589926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca0d6-f5fc-4d96-bddc-d92ae04e67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.590205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ca0d6-f5fc-4d96-bddc-d92ae04e67bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.590945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ca0d6-f5fc-4d96-bddc-d92ae04e67bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:22.592561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ca0d6-f5fc-4d96-bddc-d92ae04e67bf admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:22.602834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1074/2158] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:22.606838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16a727-d8a7-43e9-bb32-95ebff5375aa admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:22.617052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16a727-d8a7-43e9-bb32-95ebff5375aa admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:22.623008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec49b38-b76a-4d1c-9792-39b825eb786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:22.623669 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec49b38-b76a-4d1c-9792-39b825eb786d admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.623949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec49b38-b76a-4d1c-9792-39b825eb786d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.624222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec49b38-b76a-4d1c-9792-39b825eb786d admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.624960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec49b38-b76a-4d1c-9792-39b825eb786d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:22.626602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec49b38-b76a-4d1c-9792-39b825eb786d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:22.636910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1085/2159] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:22.641050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca0d6-f5fc-4d96-bddc-d92ae04e67bf admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:22.651228 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ca0d6-f5fc-4d96-bddc-d92ae04e67bf admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:22.657056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346166af-157e-4ad3-8fd4-e7cf6065c227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:22.657990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346166af-157e-4ad3-8fd4-e7cf6065c227 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.658272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346166af-157e-4ad3-8fd4-e7cf6065c227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.658531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346166af-157e-4ad3-8fd4-e7cf6065c227 admin admin] PATH_INFO: `/v3/projects/32fd0824ecfb4f2386fd61550aa0c066/users/913d7e688d5e4644b5203bc8fb614ad8/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.674066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346166af-157e-4ad3-8fd4-e7cf6065c227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fd0824ecfb4f2386fd61550aa0c066, user_id=913d7e688d5e4644b5203bc8fb614ad8, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:22.676710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346166af-157e-4ad3-8fd4-e7cf6065c227 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:22.692669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1075/2160] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:22 2022] PUT /identity/v3/projects/32fd0824ecfb4f2386fd61550aa0c066/users/913d7e688d5e4644b5203bc8fb614ad8/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:58:22.705740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fedbf-e4af-49b1-a383-80df8bb1de6d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.706136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fedbf-e4af-49b1-a383-80df8bb1de6d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.706416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fedbf-e4af-49b1-a383-80df8bb1de6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.735469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-7e0fedbf-e4af-49b1-a383-80df8bb1de6d None None] MFA Rules not processed for user `913d7e688d5e4644b5203bc8fb614ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:22.736687 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-7e0fedbf-e4af-49b1-a383-80df8bb1de6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:22.811637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1086/2161] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:22.813163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346166af-157e-4ad3-8fd4-e7cf6065c227 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:22.893148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346166af-157e-4ad3-8fd4-e7cf6065c227 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:22.899071 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf60ab6-153c-412e-a974-25a65408575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:22.899770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf60ab6-153c-412e-a974-25a65408575c admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:22.900061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf60ab6-153c-412e-a974-25a65408575c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:22.900328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf60ab6-153c-412e-a974-25a65408575c admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:22.901916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf60ab6-153c-412e-a974-25a65408575c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:22.904485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf60ab6-153c-412e-a974-25a65408575c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:22.950016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1076/2162] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:22 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:58:22.950210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fedbf-e4af-49b1-a383-80df8bb1de6d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:22.971227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fedbf-e4af-49b1-a383-80df8bb1de6d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.037780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc31cfd-cb49-46ea-8a64-c80af4cc4810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.038486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc31cfd-cb49-46ea-8a64-c80af4cc4810 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.038842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc31cfd-cb49-46ea-8a64-c80af4cc4810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.039049 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc31cfd-cb49-46ea-8a64-c80af4cc4810 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.041191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc31cfd-cb49-46ea-8a64-c80af4cc4810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.041924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc31cfd-cb49-46ea-8a64-c80af4cc4810 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.070509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1087/2163] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:22 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:23.074721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf60ab6-153c-412e-a974-25a65408575c admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.089944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf60ab6-153c-412e-a974-25a65408575c admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.102181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551451a-aed1-4565-9917-9411dd3e6562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.103127 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551451a-aed1-4565-9917-9411dd3e6562 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.103827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551451a-aed1-4565-9917-9411dd3e6562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.104223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551451a-aed1-4565-9917-9411dd3e6562 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.105079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551451a-aed1-4565-9917-9411dd3e6562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.110536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551451a-aed1-4565-9917-9411dd3e6562 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.129028 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1077/2164] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:23.130047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc31cfd-cb49-46ea-8a64-c80af4cc4810 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.144109 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc31cfd-cb49-46ea-8a64-c80af4cc4810 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.153860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1269d-9a3a-434a-9718-730f4d50d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.154617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1269d-9a3a-434a-9718-730f4d50d5cf admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.155015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1269d-9a3a-434a-9718-730f4d50d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.155328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1269d-9a3a-434a-9718-730f4d50d5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.156126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1269d-9a3a-434a-9718-730f4d50d5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.159118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1269d-9a3a-434a-9718-730f4d50d5cf admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.171769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1088/2165] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:58:23.175855 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551451a-aed1-4565-9917-9411dd3e6562 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.191519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551451a-aed1-4565-9917-9411dd3e6562 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.199511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22265060-26bc-4ec7-af59-cb14564f2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.203492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22265060-26bc-4ec7-af59-cb14564f2019 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.204854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22265060-26bc-4ec7-af59-cb14564f2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.205740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22265060-26bc-4ec7-af59-cb14564f2019 admin admin] PATH_INFO: `/v3/projects/8fa1ad2bbf9845e0b02ad6d809ea93cd/users/e8262462b58d496f811a5fc1a7e05afa/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.242993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22265060-26bc-4ec7-af59-cb14564f2019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa1ad2bbf9845e0b02ad6d809ea93cd, user_id=e8262462b58d496f811a5fc1a7e05afa, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.254366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22265060-26bc-4ec7-af59-cb14564f2019 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.280623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1078/2166] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:23 2022] PUT /identity/v3/projects/8fa1ad2bbf9845e0b02ad6d809ea93cd/users/e8262462b58d496f811a5fc1a7e05afa/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:23.291598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e369ae-229c-4a9b-bf2c-cd8ff4405438 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.291836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e369ae-229c-4a9b-bf2c-cd8ff4405438 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.292121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e369ae-229c-4a9b-bf2c-cd8ff4405438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.325852 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-08e369ae-229c-4a9b-bf2c-cd8ff4405438 None None] MFA Rules not processed for user `e8262462b58d496f811a5fc1a7e05afa`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:23.327071 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-08e369ae-229c-4a9b-bf2c-cd8ff4405438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:23.394478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1089/2167] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:23.399142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22265060-26bc-4ec7-af59-cb14564f2019 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.462833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22265060-26bc-4ec7-af59-cb14564f2019 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.468406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf60a2-23c8-44d1-a141-5f1f90346a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.469234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf60a2-23c8-44d1-a141-5f1f90346a3b admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.469550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf60a2-23c8-44d1-a141-5f1f90346a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.469826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf60a2-23c8-44d1-a141-5f1f90346a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.470545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf60a2-23c8-44d1-a141-5f1f90346a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.472473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf60a2-23c8-44d1-a141-5f1f90346a3b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.499896 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1079/2168] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:23 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:23.504111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e369ae-229c-4a9b-bf2c-cd8ff4405438 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.515801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e369ae-229c-4a9b-bf2c-cd8ff4405438 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.576354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b429379-d7bc-4f20-806b-0195de821425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.577180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429379-d7bc-4f20-806b-0195de821425 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.577681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429379-d7bc-4f20-806b-0195de821425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.577989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429379-d7bc-4f20-806b-0195de821425 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.578767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b429379-d7bc-4f20-806b-0195de821425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.580722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b429379-d7bc-4f20-806b-0195de821425 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.601353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1090/2169] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:23 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:23.605486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf60a2-23c8-44d1-a141-5f1f90346a3b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.616102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf60a2-23c8-44d1-a141-5f1f90346a3b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.621623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f1f75-b2ac-4e84-9774-8cc9e018b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.622285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f1f75-b2ac-4e84-9774-8cc9e018b8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.622560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f1f75-b2ac-4e84-9774-8cc9e018b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.622826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f1f75-b2ac-4e84-9774-8cc9e018b8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.623585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f1f75-b2ac-4e84-9774-8cc9e018b8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.625276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f1f75-b2ac-4e84-9774-8cc9e018b8b0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.635818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1080/2170] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:58:23.640220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b429379-d7bc-4f20-806b-0195de821425 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.650286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b429379-d7bc-4f20-806b-0195de821425 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.655396 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c87e1-d995-437a-a8b4-f525cbf386ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.656268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c87e1-d995-437a-a8b4-f525cbf386ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.656543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c87e1-d995-437a-a8b4-f525cbf386ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.656810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c87e1-d995-437a-a8b4-f525cbf386ea admin admin] PATH_INFO: `/v3/projects/63cc63f4b0c94caaae2d868f9de95384/users/8a48f533d8494b20b17d340f84b46bf8/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.671685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c87e1-d995-437a-a8b4-f525cbf386ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cc63f4b0c94caaae2d868f9de95384, user_id=8a48f533d8494b20b17d340f84b46bf8, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.674494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c87e1-d995-437a-a8b4-f525cbf386ea admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.688268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1091/2171] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:23 2022] PUT /identity/v3/projects/63cc63f4b0c94caaae2d868f9de95384/users/8a48f533d8494b20b17d340f84b46bf8/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:23.692532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f1f75-b2ac-4e84-9774-8cc9e018b8b0 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.703794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f1f75-b2ac-4e84-9774-8cc9e018b8b0 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.764488 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb7976-c24c-471f-9c21-d04ddc422025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.765169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb7976-c24c-471f-9c21-d04ddc422025 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.765475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb7976-c24c-471f-9c21-d04ddc422025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.765755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb7976-c24c-471f-9c21-d04ddc422025 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.766497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb7976-c24c-471f-9c21-d04ddc422025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.768116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb7976-c24c-471f-9c21-d04ddc422025 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.778099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1081/2172] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:23.782410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c87e1-d995-437a-a8b4-f525cbf386ea admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.793169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c87e1-d995-437a-a8b4-f525cbf386ea admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:23.798324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8165050-d599-4eec-90b1-b9e42128adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:23.799239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8165050-d599-4eec-90b1-b9e42128adfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.799514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8165050-d599-4eec-90b1-b9e42128adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.799783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8165050-d599-4eec-90b1-b9e42128adfb admin admin] PATH_INFO: `/v3/projects/63cc63f4b0c94caaae2d868f9de95384/users/8a48f533d8494b20b17d340f84b46bf8/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.801732 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8165050-d599-4eec-90b1-b9e42128adfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cc63f4b0c94caaae2d868f9de95384, user_id=8a48f533d8494b20b17d340f84b46bf8, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:23.804371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8165050-d599-4eec-90b1-b9e42128adfb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:23.822271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1092/2173] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:23 2022] PUT /identity/v3/projects/63cc63f4b0c94caaae2d868f9de95384/users/8a48f533d8494b20b17d340f84b46bf8/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:23.832287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc236d-3eab-4f53-9fef-72f609a85c8b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:23.841382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc236d-3eab-4f53-9fef-72f609a85c8b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:23.841382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc236d-3eab-4f53-9fef-72f609a85c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:23.861613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-89cc236d-3eab-4f53-9fef-72f609a85c8b None None] MFA Rules not processed for user `8a48f533d8494b20b17d340f84b46bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:23.863064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-89cc236d-3eab-4f53-9fef-72f609a85c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:23.942363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1082/2174] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:23.954462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8165050-d599-4eec-90b1-b9e42128adfb admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:23.956258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e8165050-d599-4eec-90b1-b9e42128adfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:24.028094 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8165050-d599-4eec-90b1-b9e42128adfb admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:24.032532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03b714-e2c1-432e-bb41-2d4d67b3da98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:24.033863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b714-e2c1-432e-bb41-2d4d67b3da98 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:24.034146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b714-e2c1-432e-bb41-2d4d67b3da98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:24.034420 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b714-e2c1-432e-bb41-2d4d67b3da98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:24.104368 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03b714-e2c1-432e-bb41-2d4d67b3da98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:24.106806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03b714-e2c1-432e-bb41-2d4d67b3da98 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:24.121834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1093/2175] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:29.852160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc236d-3eab-4f53-9fef-72f609a85c8b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:29.854072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-89cc236d-3eab-4f53-9fef-72f609a85c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:29.870047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc236d-3eab-4f53-9fef-72f609a85c8b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:29.875413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d06ee-48fa-48d0-b8ee-e82402c50d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:29.876069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d06ee-48fa-48d0-b8ee-e82402c50d2d service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:29.876404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d06ee-48fa-48d0-b8ee-e82402c50d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:29.876676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d06ee-48fa-48d0-b8ee-e82402c50d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:29.937324 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d06ee-48fa-48d0-b8ee-e82402c50d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:29.938604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d06ee-48fa-48d0-b8ee-e82402c50d2d service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:29.951247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1083/2176] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:30.689855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03b714-e2c1-432e-bb41-2d4d67b3da98 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:30.701491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03b714-e2c1-432e-bb41-2d4d67b3da98 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:30.705859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76ff54-d338-4976-be21-968e9df7875b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:30.706591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76ff54-d338-4976-be21-968e9df7875b service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:30.706927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76ff54-d338-4976-be21-968e9df7875b service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:30.707363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76ff54-d338-4976-be21-968e9df7875b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:30.718006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76ff54-d338-4976-be21-968e9df7875b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:30.719675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76ff54-d338-4976-be21-968e9df7875b service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:30.736815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1094/2177] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:37.748579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d06ee-48fa-48d0-b8ee-e82402c50d2d service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:37.814987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d06ee-48fa-48d0-b8ee-e82402c50d2d service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:37.820169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:37.821052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:37.821365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:37.821641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] PATH_INFO: `/v3/users/913d7e688d5e4644b5203bc8fb614ad8` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:37.822919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=913d7e688d5e4644b5203bc8fb614ad8)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:37.824861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:37.874203 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913d7e688d5e4644b5203bc8fb614ad8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:37.880699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913d7e688d5e4644b5203bc8fb614ad8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:37.881390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913d7e688d5e4644b5203bc8fb614ad8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:37.881990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913d7e688d5e4644b5203bc8fb614ad8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:37.890563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913d7e688d5e4644b5203bc8fb614ad8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:37.907356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1084/2178] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:37 2022] DELETE /identity/v3/users/913d7e688d5e4644b5203bc8fb614ad8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:37.912021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb3da-16e4-47aa-a3f7-96e1d2190bf2 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:37.912555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb3da-16e4-47aa-a3f7-96e1d2190bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:37.912555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb3da-16e4-47aa-a3f7-96e1d2190bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:37.930909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-0e0fb3da-16e4-47aa-a3f7-96e1d2190bf2 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:37.932143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0e0fb3da-16e4-47aa-a3f7-96e1d2190bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:37.994007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1095/2179] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:38.004358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:38.005871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:38.062154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca584-aea6-4aff-9e03-f478b58e9c38 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:38.065830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53391a71-2e47-4828-b27b-a46c874f93ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:38.066482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391a71-2e47-4828-b27b-a46c874f93ad service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:38.066763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391a71-2e47-4828-b27b-a46c874f93ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:38.067031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391a71-2e47-4828-b27b-a46c874f93ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:38.076449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391a71-2e47-4828-b27b-a46c874f93ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:38.077938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391a71-2e47-4828-b27b-a46c874f93ad service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:38.087718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1085/2180] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:38.429086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fb3da-16e4-47aa-a3f7-96e1d2190bf2 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:38.430578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0e0fb3da-16e4-47aa-a3f7-96e1d2190bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:38.448696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fb3da-16e4-47aa-a3f7-96e1d2190bf2 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:38.455837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:38.456713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:38.456991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:38.457274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] PATH_INFO: `/v3/projects/32fd0824ecfb4f2386fd61550aa0c066` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:38.458544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fd0824ecfb4f2386fd61550aa0c066)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:38.460545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:38.522510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fd0824ecfb4f2386fd61550aa0c066', 'request_id': 'req-652df418-a2fd-43b2-ae73-d39303af50cb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.532103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fd0824ecfb4f2386fd61550aa0c066', 'request_id': 'req-652df418-a2fd-43b2-ae73-d39303af50cb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.546353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fd0824ecfb4f2386fd61550aa0c066', 'request_id': 'req-652df418-a2fd-43b2-ae73-d39303af50cb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.556582 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] The token cache is being invalidate because project 32fd0824ecfb4f2386fd61550aa0c066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:38.556957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.557798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.560120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1096/2181] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:38 2022] DELETE /identity/v3/projects/32fd0824ecfb4f2386fd61550aa0c066 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:38.564837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53391a71-2e47-4828-b27b-a46c874f93ad service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:38.577108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53391a71-2e47-4828-b27b-a46c874f93ad service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:38.646327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:38.647429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:38.647872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:38.648310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] PATH_INFO: `/v3/users/e8262462b58d496f811a5fc1a7e05afa` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:38.649609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8262462b58d496f811a5fc1a7e05afa)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:38.651534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:38.715741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8262462b58d496f811a5fc1a7e05afa'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.722634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8262462b58d496f811a5fc1a7e05afa'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.723338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8262462b58d496f811a5fc1a7e05afa'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.723917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8262462b58d496f811a5fc1a7e05afa'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.732526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8262462b58d496f811a5fc1a7e05afa'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:38.756797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1086/2182] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:38 2022] DELETE /identity/v3/users/e8262462b58d496f811a5fc1a7e05afa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:39.033350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:39.035358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:39.051197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652df418-a2fd-43b2-ae73-d39303af50cb admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:39.116108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:39.117246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:39.117602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:39.117880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] PATH_INFO: `/v3/projects/8fa1ad2bbf9845e0b02ad6d809ea93cd` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:39.119459 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa1ad2bbf9845e0b02ad6d809ea93cd)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:39.121452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:39.170823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa1ad2bbf9845e0b02ad6d809ea93cd', 'request_id': 'req-06517d25-ad67-4b44-907c-4562b4cdf684'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.178366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa1ad2bbf9845e0b02ad6d809ea93cd', 'request_id': 'req-06517d25-ad67-4b44-907c-4562b4cdf684'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.184746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa1ad2bbf9845e0b02ad6d809ea93cd', 'request_id': 'req-06517d25-ad67-4b44-907c-4562b4cdf684'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.195608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] The token cache is being invalidate because project 8fa1ad2bbf9845e0b02ad6d809ea93cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:39.196107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.197012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.198788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1097/2183] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:39 2022] DELETE /identity/v3/projects/8fa1ad2bbf9845e0b02ad6d809ea93cd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:39.202817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:39.204398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:39.218359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131385b2-5488-4b32-b91c-7488b48aea7c admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:39.278894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:39.279944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:39.280245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:39.280516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] PATH_INFO: `/v3/users/8a48f533d8494b20b17d340f84b46bf8` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:39.281747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a48f533d8494b20b17d340f84b46bf8)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:39.283729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:39.333699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a48f533d8494b20b17d340f84b46bf8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.340201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a48f533d8494b20b17d340f84b46bf8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.340891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a48f533d8494b20b17d340f84b46bf8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.341618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a48f533d8494b20b17d340f84b46bf8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.350193 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0c941e31-c2d2-46a7-a60b-b02569bf0418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a48f533d8494b20b17d340f84b46bf8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.367702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1087/2184] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:39 2022] DELETE /identity/v3/users/8a48f533d8494b20b17d340f84b46bf8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:39.702911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:39.704524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:39.717565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06517d25-ad67-4b44-907c-4562b4cdf684 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:39.796249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:39.797406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:39.797861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:39.798134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] PATH_INFO: `/v3/projects/63cc63f4b0c94caaae2d868f9de95384` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:39.799356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cc63f4b0c94caaae2d868f9de95384)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:39.801268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:39.877188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cc63f4b0c94caaae2d868f9de95384', 'request_id': 'req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.886868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cc63f4b0c94caaae2d868f9de95384', 'request_id': 'req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.901522 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cc63f4b0c94caaae2d868f9de95384', 'request_id': 'req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.916745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] The token cache is being invalidate because project 63cc63f4b0c94caaae2d868f9de95384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:39.917004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.918209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a48f33fb-2fe2-403f-a0fb-3a7dbb260a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:39.920137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1098/2185] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:39 2022] DELETE /identity/v3/projects/63cc63f4b0c94caaae2d868f9de95384 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:39.928953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22021b24-9a3f-420e-b2e3-f50501eb999b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:39.929584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22021b24-9a3f-420e-b2e3-f50501eb999b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:39.929584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22021b24-9a3f-420e-b2e3-f50501eb999b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:39.950000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-22021b24-9a3f-420e-b2e3-f50501eb999b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:39.951302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-22021b24-9a3f-420e-b2e3-f50501eb999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:40.025087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1088/2186] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:40.033570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11bbb4-a09b-42f4-a0b9-cdabfb1a99f8 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:40.034060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11bbb4-a09b-42f4-a0b9-cdabfb1a99f8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:40.034166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11bbb4-a09b-42f4-a0b9-cdabfb1a99f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:40.055553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6a11bbb4-a09b-42f4-a0b9-cdabfb1a99f8 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:40.056765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6a11bbb4-a09b-42f4-a0b9-cdabfb1a99f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:40.064771 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1099/2187] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:40.069259 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22021b24-9a3f-420e-b2e3-f50501eb999b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:40.079113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22021b24-9a3f-420e-b2e3-f50501eb999b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:40.084537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5098e-7f66-4d90-99e8-9e74c55322e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:40.085203 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5098e-7f66-4d90-99e8-9e74c55322e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:40.085506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5098e-7f66-4d90-99e8-9e74c55322e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:40.085773 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5098e-7f66-4d90-99e8-9e74c55322e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:40.086658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5098e-7f66-4d90-99e8-9e74c55322e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:40.086969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5098e-7f66-4d90-99e8-9e74c55322e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:40.088545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5098e-7f66-4d90-99e8-9e74c55322e3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:40.101435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1089/2188] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 18:58:40.107765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11bbb4-a09b-42f4-a0b9-cdabfb1a99f8 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:40.117269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11bbb4-a09b-42f4-a0b9-cdabfb1a99f8 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:40.123452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123a7fc-43a3-43f2-8bba-5f6f09433165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:40.124261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123a7fc-43a3-43f2-8bba-5f6f09433165 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:40.124592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123a7fc-43a3-43f2-8bba-5f6f09433165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:40.124869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123a7fc-43a3-43f2-8bba-5f6f09433165 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:40.125664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123a7fc-43a3-43f2-8bba-5f6f09433165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:40.128028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123a7fc-43a3-43f2-8bba-5f6f09433165 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:40.157025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1100/2189] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:40 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:40.161252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5098e-7f66-4d90-99e8-9e74c55322e3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:40.173023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5098e-7f66-4d90-99e8-9e74c55322e3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:40.230708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6eb8c-702f-467c-b00b-bf346e3eeca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:40.231384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6eb8c-702f-467c-b00b-bf346e3eeca0 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:40.231661 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6eb8c-702f-467c-b00b-bf346e3eeca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:40.231935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6eb8c-702f-467c-b00b-bf346e3eeca0 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:40.232718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6eb8c-702f-467c-b00b-bf346e3eeca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:40.234755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6eb8c-702f-467c-b00b-bf346e3eeca0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:40.256226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1090/2190] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:40 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:40.260568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123a7fc-43a3-43f2-8bba-5f6f09433165 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:40.272803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123a7fc-43a3-43f2-8bba-5f6f09433165 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:40.278691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9cdee-9f4e-4708-8e4e-ca901a800c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:40.279511 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9cdee-9f4e-4708-8e4e-ca901a800c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:40.279796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9cdee-9f4e-4708-8e4e-ca901a800c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:40.280058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9cdee-9f4e-4708-8e4e-ca901a800c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:40.280821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9cdee-9f4e-4708-8e4e-ca901a800c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:40.282460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9cdee-9f4e-4708-8e4e-ca901a800c99 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:40.294375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1101/2191] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:40.298714 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6eb8c-702f-467c-b00b-bf346e3eeca0 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:40.309252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6eb8c-702f-467c-b00b-bf346e3eeca0 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:40.313993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2975b7-3ba4-413c-b941-ddb400920e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:40.314671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2975b7-3ba4-413c-b941-ddb400920e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:40.314951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2975b7-3ba4-413c-b941-ddb400920e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:40.315861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2975b7-3ba4-413c-b941-ddb400920e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:40.316616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2975b7-3ba4-413c-b941-ddb400920e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:40.318328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2975b7-3ba4-413c-b941-ddb400920e7b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:40.328651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1091/2192] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:40.333464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9cdee-9f4e-4708-8e4e-ca901a800c99 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:40.344195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9cdee-9f4e-4708-8e4e-ca901a800c99 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:40.349117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d16ddb-ba36-4828-8a49-e74971ea9e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:40.350040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16ddb-ba36-4828-8a49-e74971ea9e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:40.350322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16ddb-ba36-4828-8a49-e74971ea9e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:40.350600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16ddb-ba36-4828-8a49-e74971ea9e9d admin admin] PATH_INFO: `/v3/projects/bbe01dbbc9a24be6be531f155c9f8957/users/bba13c356dfc4f7b84ccf6a8ce1e523c/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:40.368031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d16ddb-ba36-4828-8a49-e74971ea9e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe01dbbc9a24be6be531f155c9f8957, user_id=bba13c356dfc4f7b84ccf6a8ce1e523c, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:40.371265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d16ddb-ba36-4828-8a49-e74971ea9e9d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:40.391069 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1102/2193] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:40 2022] PUT /identity/v3/projects/bbe01dbbc9a24be6be531f155c9f8957/users/bba13c356dfc4f7b84ccf6a8ce1e523c/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:40.401563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45f26-2994-4476-a180-0cf1a6189f21 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:40.402031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45f26-2994-4476-a180-0cf1a6189f21 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:40.402305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45f26-2994-4476-a180-0cf1a6189f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:40.442913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c9f45f26-2994-4476-a180-0cf1a6189f21 None None] MFA Rules not processed for user `bba13c356dfc4f7b84ccf6a8ce1e523c`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:40.442913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c9f45f26-2994-4476-a180-0cf1a6189f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:40.505779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1092/2194] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:40.517236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d16ddb-ba36-4828-8a49-e74971ea9e9d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:40.519375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d5d16ddb-ba36-4828-8a49-e74971ea9e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:40.584391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d16ddb-ba36-4828-8a49-e74971ea9e9d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:40.587988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a424c6d-b48d-4973-b991-fe3f5a8fe5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:40.588638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a424c6d-b48d-4973-b991-fe3f5a8fe5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:40.588912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a424c6d-b48d-4973-b991-fe3f5a8fe5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:40.589184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a424c6d-b48d-4973-b991-fe3f5a8fe5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:40.598119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a424c6d-b48d-4973-b991-fe3f5a8fe5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:40.599545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a424c6d-b48d-4973-b991-fe3f5a8fe5f6 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:40.608284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1103/2195] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:40.981013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45f26-2994-4476-a180-0cf1a6189f21 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:40.983938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c9f45f26-2994-4476-a180-0cf1a6189f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:41.055965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45f26-2994-4476-a180-0cf1a6189f21 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:41.060378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:41.061339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.061620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.061894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] PATH_INFO: `/v3/users/b52bc758f6574b0dbf5cdbcaae766f83` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.063180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52bc758f6574b0dbf5cdbcaae766f83)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:41.065116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:41.114057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52bc758f6574b0dbf5cdbcaae766f83'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.121185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52bc758f6574b0dbf5cdbcaae766f83'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.121863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52bc758f6574b0dbf5cdbcaae766f83'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.122442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52bc758f6574b0dbf5cdbcaae766f83'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.131148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52bc758f6574b0dbf5cdbcaae766f83'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.150567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1093/2196] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:58:40 2022] DELETE /identity/v3/users/b52bc758f6574b0dbf5cdbcaae766f83 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:41.155044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c658-b099-4305-9e92-932ecc2bce91 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.155516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c658-b099-4305-9e92-932ecc2bce91 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.155616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c658-b099-4305-9e92-932ecc2bce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.185063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-bf55c658-b099-4305-9e92-932ecc2bce91 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:41.186447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-bf55c658-b099-4305-9e92-932ecc2bce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:41.250086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1104/2197] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:41.259619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:41.261088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:41.316741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1a81f-1740-43e8-ae30-6733fc7e23a9 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:41.320397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afef1b6-72ca-427b-b6d2-c88f152abe89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:41.321057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afef1b6-72ca-427b-b6d2-c88f152abe89 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.321358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afef1b6-72ca-427b-b6d2-c88f152abe89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.321628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afef1b6-72ca-427b-b6d2-c88f152abe89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.331238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afef1b6-72ca-427b-b6d2-c88f152abe89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:41.332687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afef1b6-72ca-427b-b6d2-c88f152abe89 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:41.342689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1094/2198] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:41.633560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55c658-b099-4305-9e92-932ecc2bce91 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:41.635318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-bf55c658-b099-4305-9e92-932ecc2bce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:41.647100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55c658-b099-4305-9e92-932ecc2bce91 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:41.651998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:41.652864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.653139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.653445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] PATH_INFO: `/v3/projects/cbbfe2df4f924542b6bd43356118817b` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.654942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbbfe2df4f924542b6bd43356118817b)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:41.661320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:41.706961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbbfe2df4f924542b6bd43356118817b', 'request_id': 'req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.715152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbbfe2df4f924542b6bd43356118817b', 'request_id': 'req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.721268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbbfe2df4f924542b6bd43356118817b', 'request_id': 'req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.731746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] The token cache is being invalidate because project cbbfe2df4f924542b6bd43356118817b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:58:41.732027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.732634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ff8ab78e-4bdc-4239-afd6-3e053fad08fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:58:41.734239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1105/2199] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:58:41 2022] DELETE /identity/v3/projects/cbbfe2df4f924542b6bd43356118817b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:41.740730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f8fc-e4fa-491f-ade2-ead9e15455d0 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.741012 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f8fc-e4fa-491f-ade2-ead9e15455d0 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.741297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f8fc-e4fa-491f-ade2-ead9e15455d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.763687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-c576f8fc-e4fa-491f-ade2-ead9e15455d0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:41.765003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c576f8fc-e4fa-491f-ade2-ead9e15455d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:41.797979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d72df-d7fd-4ee2-b4ed-58eedea31bd8 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.798263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d72df-d7fd-4ee2-b4ed-58eedea31bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.798540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d72df-d7fd-4ee2-b4ed-58eedea31bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.817465 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-873d72df-d7fd-4ee2-b4ed-58eedea31bd8 None None] MFA Rules not processed for user `b59093d4f76e4fdabe8e41440cf31f32`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:41.818686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-873d72df-d7fd-4ee2-b4ed-58eedea31bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:41.827625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1095/2200] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:41.835630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d315be-149a-4470-9d5c-ad1b06e9954f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.835938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d315be-149a-4470-9d5c-ad1b06e9954f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.836235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d315be-149a-4470-9d5c-ad1b06e9954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.854479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-12d315be-149a-4470-9d5c-ad1b06e9954f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:41.855777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-12d315be-149a-4470-9d5c-ad1b06e9954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:41.864404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1096/2201] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:41.868657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d315be-149a-4470-9d5c-ad1b06e9954f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:41.877055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1106/2202] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 18:58:41.878387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d315be-149a-4470-9d5c-ad1b06e9954f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:41.883943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c410d3b-5022-4018-bcb7-202433362293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:41.884621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c410d3b-5022-4018-bcb7-202433362293 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.884897 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c410d3b-5022-4018-bcb7-202433362293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.885189 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c410d3b-5022-4018-bcb7-202433362293 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.885975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c410d3b-5022-4018-bcb7-202433362293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 18:58:41.886276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c410d3b-5022-4018-bcb7-202433362293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:41.887872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c410d3b-5022-4018-bcb7-202433362293 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:41.900176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1097/2203] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 18:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 18:58:41.905172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d72df-d7fd-4ee2-b4ed-58eedea31bd8 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:41.919230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d72df-d7fd-4ee2-b4ed-58eedea31bd8 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:41.925308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9aca7-d797-47cf-9c6d-76da24a8fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:41.925308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9aca7-d797-47cf-9c6d-76da24a8fe7a admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:41.925308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9aca7-d797-47cf-9c6d-76da24a8fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:41.925308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9aca7-d797-47cf-9c6d-76da24a8fe7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:41.925858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9aca7-d797-47cf-9c6d-76da24a8fe7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:41.927892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9aca7-d797-47cf-9c6d-76da24a8fe7a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:41.957001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1107/2204] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:41 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 18:58:41.961352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c410d3b-5022-4018-bcb7-202433362293 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:41.979795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c410d3b-5022-4018-bcb7-202433362293 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:42.039251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e316f5-8a42-469f-9294-0d807c45be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:42.039958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e316f5-8a42-469f-9294-0d807c45be77 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:42.040414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e316f5-8a42-469f-9294-0d807c45be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:42.040700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e316f5-8a42-469f-9294-0d807c45be77 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:42.041452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e316f5-8a42-469f-9294-0d807c45be77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:42.043450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e316f5-8a42-469f-9294-0d807c45be77 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:42.070534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1098/2205] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:41 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:42.072798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9aca7-d797-47cf-9c6d-76da24a8fe7a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:42.085448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9aca7-d797-47cf-9c6d-76da24a8fe7a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:42.100673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5016a-0175-4157-adf9-a7e4e1daaa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:42.101501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5016a-0175-4157-adf9-a7e4e1daaa2a admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:42.101813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5016a-0175-4157-adf9-a7e4e1daaa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:42.102087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5016a-0175-4157-adf9-a7e4e1daaa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:42.102894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5016a-0175-4157-adf9-a7e4e1daaa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:42.104717 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5016a-0175-4157-adf9-a7e4e1daaa2a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:42.118852 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1108/2206] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:58:42.123164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e316f5-8a42-469f-9294-0d807c45be77 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:42.134554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e316f5-8a42-469f-9294-0d807c45be77 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:42.140822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e604ad-3448-4e68-b2e3-177020168319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:42.141633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e604ad-3448-4e68-b2e3-177020168319 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:42.141922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e604ad-3448-4e68-b2e3-177020168319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:42.142178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e604ad-3448-4e68-b2e3-177020168319 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:42.142961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e604ad-3448-4e68-b2e3-177020168319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:42.144729 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e604ad-3448-4e68-b2e3-177020168319 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:42.158518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1099/2207] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 18:58:42.162237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5016a-0175-4157-adf9-a7e4e1daaa2a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:42.175119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5016a-0175-4157-adf9-a7e4e1daaa2a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:42.181002 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8a9af-8b74-47ab-970c-3a35847d3495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:42.182502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8a9af-8b74-47ab-970c-3a35847d3495 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:42.183178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8a9af-8b74-47ab-970c-3a35847d3495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:42.183588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8a9af-8b74-47ab-970c-3a35847d3495 admin admin] PATH_INFO: `/v3/projects/8bf2894c75244d3f8e2c83c7deb9ab3e/users/8d4c2574bb2844d5ab718dff3cf275e0/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:42.205311 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8a9af-8b74-47ab-970c-3a35847d3495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf2894c75244d3f8e2c83c7deb9ab3e, user_id=8d4c2574bb2844d5ab718dff3cf275e0, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:42.208659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8a9af-8b74-47ab-970c-3a35847d3495 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:42.230752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1109/2208] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:42 2022] PUT /identity/v3/projects/8bf2894c75244d3f8e2c83c7deb9ab3e/users/8d4c2574bb2844d5ab718dff3cf275e0/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:42.232482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28acb7-0494-4975-9240-6c0c7629394a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:42.232803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28acb7-0494-4975-9240-6c0c7629394a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:42.233125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28acb7-0494-4975-9240-6c0c7629394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:42.254616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ca28acb7-0494-4975-9240-6c0c7629394a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:42.255879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ca28acb7-0494-4975-9240-6c0c7629394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:42.317263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1100/2209] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:42.326963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8a9af-8b74-47ab-970c-3a35847d3495 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:42.328820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-62d8a9af-8b74-47ab-970c-3a35847d3495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:42.388653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8a9af-8b74-47ab-970c-3a35847d3495 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:42.392528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa5cc-b796-4fad-b170-35bd7288de40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:42.393188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa5cc-b796-4fad-b170-35bd7288de40 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:42.393508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa5cc-b796-4fad-b170-35bd7288de40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:42.393776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa5cc-b796-4fad-b170-35bd7288de40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:42.403260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faa5cc-b796-4fad-b170-35bd7288de40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:42.404739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faa5cc-b796-4fad-b170-35bd7288de40 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:42.415040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1110/2210] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:47.562091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ec6b6-65d9-40b8-852d-b4b191293ea5 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:47.563017 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ec6b6-65d9-40b8-852d-b4b191293ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:47.563520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ec6b6-65d9-40b8-852d-b4b191293ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:47.592756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-cc9ec6b6-65d9-40b8-852d-b4b191293ea5 None None] MFA Rules not processed for user `8d4c2574bb2844d5ab718dff3cf275e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:47.594261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cc9ec6b6-65d9-40b8-852d-b4b191293ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:47.660956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1101/2211] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:47.665488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa5cc-b796-4fad-b170-35bd7288de40 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:47.675499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa5cc-b796-4fad-b170-35bd7288de40 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:47.680234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16289565-2461-4e96-9d95-4606e87994ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:47.680900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16289565-2461-4e96-9d95-4606e87994ce admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:47.681179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16289565-2461-4e96-9d95-4606e87994ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:47.681495 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16289565-2461-4e96-9d95-4606e87994ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:47.682187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16289565-2461-4e96-9d95-4606e87994ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:47.684129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16289565-2461-4e96-9d95-4606e87994ce admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:47.710380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1111/2212] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 18:58:47 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:47.714431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ec6b6-65d9-40b8-852d-b4b191293ea5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:47.725764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ec6b6-65d9-40b8-852d-b4b191293ea5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:47.784102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64a7c9-6936-4f18-a911-f20d69660456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:47.784833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64a7c9-6936-4f18-a911-f20d69660456 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:47.785085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64a7c9-6936-4f18-a911-f20d69660456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:47.785397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64a7c9-6936-4f18-a911-f20d69660456 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:47.786103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64a7c9-6936-4f18-a911-f20d69660456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:47.788069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64a7c9-6936-4f18-a911-f20d69660456 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:47.810961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1102/2213] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 18:58:47 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 18:58:47.815033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16289565-2461-4e96-9d95-4606e87994ce admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:47.825497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16289565-2461-4e96-9d95-4606e87994ce admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:47.831061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085ae47-af31-420b-ae5f-080ec6399274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:47.831733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085ae47-af31-420b-ae5f-080ec6399274 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:47.832012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085ae47-af31-420b-ae5f-080ec6399274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:47.832284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085ae47-af31-420b-ae5f-080ec6399274 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:47.833020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085ae47-af31-420b-ae5f-080ec6399274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:47.834677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085ae47-af31-420b-ae5f-080ec6399274 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:47.845499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1112/2214] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:47.849840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64a7c9-6936-4f18-a911-f20d69660456 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:47.862995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64a7c9-6936-4f18-a911-f20d69660456 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:47.868389 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8f896-ed2d-4a18-977f-6a453fff3823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:47.869681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8f896-ed2d-4a18-977f-6a453fff3823 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:47.869960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8f896-ed2d-4a18-977f-6a453fff3823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:47.870268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8f896-ed2d-4a18-977f-6a453fff3823 admin admin] PATH_INFO: `/v3/projects/35ee653d6d2a4669b9161bbdf73b726c/users/5a9c89238e5b41c29fe9c24318a53b64/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:47.885765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8f896-ed2d-4a18-977f-6a453fff3823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ee653d6d2a4669b9161bbdf73b726c, user_id=5a9c89238e5b41c29fe9c24318a53b64, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:47.888459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8f896-ed2d-4a18-977f-6a453fff3823 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:47.904488 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1103/2215] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:47 2022] PUT /identity/v3/projects/35ee653d6d2a4669b9161bbdf73b726c/users/5a9c89238e5b41c29fe9c24318a53b64/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:47.908677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085ae47-af31-420b-ae5f-080ec6399274 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:47.919333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085ae47-af31-420b-ae5f-080ec6399274 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:47.985794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac111-c680-498f-b9dc-8cf0d60347eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:47.986484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac111-c680-498f-b9dc-8cf0d60347eb admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:47.986756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac111-c680-498f-b9dc-8cf0d60347eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:47.987024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac111-c680-498f-b9dc-8cf0d60347eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:47.987762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaac111-c680-498f-b9dc-8cf0d60347eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:47.989394 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaac111-c680-498f-b9dc-8cf0d60347eb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:48.000510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1113/2216] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 18:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 18:58:48.004678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8f896-ed2d-4a18-977f-6a453fff3823 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:48.015587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8f896-ed2d-4a18-977f-6a453fff3823 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:48.020707 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ad75-39bc-499b-89f2-13b1fb35a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:48.021630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ad75-39bc-499b-89f2-13b1fb35a4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:48.021908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ad75-39bc-499b-89f2-13b1fb35a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:48.022194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ad75-39bc-499b-89f2-13b1fb35a4cd admin admin] PATH_INFO: `/v3/projects/35ee653d6d2a4669b9161bbdf73b726c/users/5a9c89238e5b41c29fe9c24318a53b64/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:48.024262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984ad75-39bc-499b-89f2-13b1fb35a4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ee653d6d2a4669b9161bbdf73b726c, user_id=5a9c89238e5b41c29fe9c24318a53b64, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:48.027043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984ad75-39bc-499b-89f2-13b1fb35a4cd admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:48.043790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1104/2217] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 18:58:48 2022] PUT /identity/v3/projects/35ee653d6d2a4669b9161bbdf73b726c/users/5a9c89238e5b41c29fe9c24318a53b64/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:58:53.825758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac0afa-b0ab-4dcc-91af-08a95bb7f30e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:53.826402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac0afa-b0ab-4dcc-91af-08a95bb7f30e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:53.826609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac0afa-b0ab-4dcc-91af-08a95bb7f30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:53.861614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5bac0afa-b0ab-4dcc-91af-08a95bb7f30e None None] MFA Rules not processed for user `5a9c89238e5b41c29fe9c24318a53b64`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:53.863563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5bac0afa-b0ab-4dcc-91af-08a95bb7f30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:53.932590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1114/2218] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:58:53.943340 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ad75-39bc-499b-89f2-13b1fb35a4cd admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:58:53.945253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5984ad75-39bc-499b-89f2-13b1fb35a4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:54.024076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ad75-39bc-499b-89f2-13b1fb35a4cd admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:58:54.030530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fca9e-64b7-42ef-8ad9-7b61946f88f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:58:54.031690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fca9e-64b7-42ef-8ad9-7b61946f88f5 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:54.031997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fca9e-64b7-42ef-8ad9-7b61946f88f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:54.032445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fca9e-64b7-42ef-8ad9-7b61946f88f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:54.091800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fca9e-64b7-42ef-8ad9-7b61946f88f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:58:54.093564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fca9e-64b7-42ef-8ad9-7b61946f88f5 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:58:54.103965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1105/2219] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:58:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:58:57.029003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038afc4-4b6c-4dfb-a2aa-e6c523f1889d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:58:57.029548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038afc4-4b6c-4dfb-a2aa-e6c523f1889d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:58:57.029548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038afc4-4b6c-4dfb-a2aa-e6c523f1889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:58:57.051304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3038afc4-4b6c-4dfb-a2aa-e6c523f1889d None None] MFA Rules not processed for user `8d4c2574bb2844d5ab718dff3cf275e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:58:57.052853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3038afc4-4b6c-4dfb-a2aa-e6c523f1889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:58:57.060905 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1115/2220] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:58:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:00.739286 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fca9e-64b7-42ef-8ad9-7b61946f88f5 service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:00.742209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4e1fca9e-64b7-42ef-8ad9-7b61946f88f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:00.825939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fca9e-64b7-42ef-8ad9-7b61946f88f5 service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:00.835777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:00.836953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:00.837236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:00.837568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] PATH_INFO: `/v3/users/bba13c356dfc4f7b84ccf6a8ce1e523c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:00.838785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba13c356dfc4f7b84ccf6a8ce1e523c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:00.840720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:00.895140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba13c356dfc4f7b84ccf6a8ce1e523c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:00.901675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba13c356dfc4f7b84ccf6a8ce1e523c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:00.902344 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba13c356dfc4f7b84ccf6a8ce1e523c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:00.902952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba13c356dfc4f7b84ccf6a8ce1e523c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:00.911952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba13c356dfc4f7b84ccf6a8ce1e523c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:00.930149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1106/2221] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:59:00 2022] DELETE /identity/v3/users/bba13c356dfc4f7b84ccf6a8ce1e523c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:59:00.934757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469be0ea-b1af-447d-bf00-23785ac12716 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:00.935243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469be0ea-b1af-447d-bf00-23785ac12716 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:00.935389 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469be0ea-b1af-447d-bf00-23785ac12716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:00.954451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-469be0ea-b1af-447d-bf00-23785ac12716 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:00.955934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-469be0ea-b1af-447d-bf00-23785ac12716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:01.022453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1116/2222] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:01.033813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:01.035283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:01.091255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066c60-d844-426e-8273-c2757dd4151f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:01.095823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc121-9bae-4a52-951a-7000f8d7e765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:01.096494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc121-9bae-4a52-951a-7000f8d7e765 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:01.096786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc121-9bae-4a52-951a-7000f8d7e765 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:01.097063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc121-9bae-4a52-951a-7000f8d7e765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:01.108591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc121-9bae-4a52-951a-7000f8d7e765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:01.110810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc121-9bae-4a52-951a-7000f8d7e765 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:01.123029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1107/2223] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:01.462083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469be0ea-b1af-447d-bf00-23785ac12716 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:01.464299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-469be0ea-b1af-447d-bf00-23785ac12716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:01.478480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469be0ea-b1af-447d-bf00-23785ac12716 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:01.484074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc121-9bae-4a52-951a-7000f8d7e765 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:01.485071 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5bdfc121-9bae-4a52-951a-7000f8d7e765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:01.489515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:01.490616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:01.491047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:01.491483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] PATH_INFO: `/v3/users/56a3f9a98a1443acb67637d40124e4b0` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:01.492861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a3f9a98a1443acb67637d40124e4b0)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:01.495841 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:01.517219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc121-9bae-4a52-951a-7000f8d7e765 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:01.523021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:01.524293 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:01.524726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:01.525124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] PATH_INFO: `/v3/projects/bbe01dbbc9a24be6be531f155c9f8957` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:01.527104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe01dbbc9a24be6be531f155c9f8957)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:01.529051 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:01.564842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a3f9a98a1443acb67637d40124e4b0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.572944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a3f9a98a1443acb67637d40124e4b0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.574475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a3f9a98a1443acb67637d40124e4b0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.575171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a3f9a98a1443acb67637d40124e4b0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.584763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d8ab6f52-b9e0-4d30-aec9-fcce3b7da712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a3f9a98a1443acb67637d40124e4b0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.593253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe01dbbc9a24be6be531f155c9f8957', 'request_id': 'req-56a07706-028d-4ea3-adb1-7c1cafa69fca'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.602828 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1117/2224] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:59:01 2022] DELETE /identity/v3/users/56a3f9a98a1443acb67637d40124e4b0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:59:01.609044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe01dbbc9a24be6be531f155c9f8957', 'request_id': 'req-56a07706-028d-4ea3-adb1-7c1cafa69fca'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.609851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5cd0d-bacf-4bb8-8634-18d96b54586d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:01.610165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5cd0d-bacf-4bb8-8634-18d96b54586d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:01.610441 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5cd0d-bacf-4bb8-8634-18d96b54586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:01.618587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe01dbbc9a24be6be531f155c9f8957', 'request_id': 'req-56a07706-028d-4ea3-adb1-7c1cafa69fca'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.631075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] The token cache is being invalidate because project bbe01dbbc9a24be6be531f155c9f8957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:59:01.631360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.631996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:01.633657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1108/2225] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:59:01 2022] DELETE /identity/v3/projects/bbe01dbbc9a24be6be531f155c9f8957 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 18:59:01.634206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a2c5cd0d-bacf-4bb8-8634-18d96b54586d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:01.635874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a2c5cd0d-bacf-4bb8-8634-18d96b54586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:01.708930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1118/2226] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:01.719335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:01.720861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:01.783552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a07706-028d-4ea3-adb1-7c1cafa69fca admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:01.835721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd842cfb-860e-405a-88d9-2da69533a444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:01.836415 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd842cfb-860e-405a-88d9-2da69533a444 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:01.836688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd842cfb-860e-405a-88d9-2da69533a444 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:01.836956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd842cfb-860e-405a-88d9-2da69533a444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:01.846626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd842cfb-860e-405a-88d9-2da69533a444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:01.848058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd842cfb-860e-405a-88d9-2da69533a444 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:01.859902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1109/2227] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 18:59:02.129855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5cd0d-bacf-4bb8-8634-18d96b54586d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:02.131853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a2c5cd0d-bacf-4bb8-8634-18d96b54586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:02.146567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5cd0d-bacf-4bb8-8634-18d96b54586d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:02.151877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:02.153110 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:02.153516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:02.154023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] PATH_INFO: `/v3/projects/db6a31b239a2435faa31560ce7b0eda8` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:02.155498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6a31b239a2435faa31560ce7b0eda8)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:02.158060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:02.209623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6a31b239a2435faa31560ce7b0eda8', 'request_id': 'req-5392fc0e-8fcb-428b-9393-3087068f2af6'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:02.218884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6a31b239a2435faa31560ce7b0eda8', 'request_id': 'req-5392fc0e-8fcb-428b-9393-3087068f2af6'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:02.228569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6a31b239a2435faa31560ce7b0eda8', 'request_id': 'req-5392fc0e-8fcb-428b-9393-3087068f2af6'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:02.240478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] The token cache is being invalidate because project db6a31b239a2435faa31560ce7b0eda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:59:02.240694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:02.241573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5392fc0e-8fcb-428b-9393-3087068f2af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:02.243401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1119/2228] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:59:02 2022] DELETE /identity/v3/projects/db6a31b239a2435faa31560ce7b0eda8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:59:04.012996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75e751-6d46-4142-82ce-5b7c6634c02b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:04.013571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75e751-6d46-4142-82ce-5b7c6634c02b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:04.013671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75e751-6d46-4142-82ce-5b7c6634c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:04.043910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-4d75e751-6d46-4142-82ce-5b7c6634c02b None None] MFA Rules not processed for user `c983699bd73f41fc813c41c498261ece`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:04.045162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4d75e751-6d46-4142-82ce-5b7c6634c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:04.129744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1110/2229] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:59:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:14.247579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456a51c-c1f3-4d10-9549-64c77ec1f354 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:14.248147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456a51c-c1f3-4d10-9549-64c77ec1f354 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:14.248147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456a51c-c1f3-4d10-9549-64c77ec1f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:14.268153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5456a51c-c1f3-4d10-9549-64c77ec1f354 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:14.269716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5456a51c-c1f3-4d10-9549-64c77ec1f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:14.371081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1120/2230] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:14.424081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75e751-6d46-4142-82ce-5b7c6634c02b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:14.427560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4d75e751-6d46-4142-82ce-5b7c6634c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:14.516255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75e751-6d46-4142-82ce-5b7c6634c02b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:14.521156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0aefa-0165-45fb-99be-cb36278aefc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:14.521849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0aefa-0165-45fb-99be-cb36278aefc4 service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:14.522131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0aefa-0165-45fb-99be-cb36278aefc4 service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:14.522414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0aefa-0165-45fb-99be-cb36278aefc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:14.531291 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0aefa-0165-45fb-99be-cb36278aefc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:14.533109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0aefa-0165-45fb-99be-cb36278aefc4 service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:14.544115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1111/2231] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 18:59:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:59:29.528087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcccf7c-e26e-44a1-9c20-ba78bb22dadf None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:29.528638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcccf7c-e26e-44a1-9c20-ba78bb22dadf None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:29.528933 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcccf7c-e26e-44a1-9c20-ba78bb22dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:29.548079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9dcccf7c-e26e-44a1-9c20-ba78bb22dadf None None] MFA Rules not processed for user `c6dc233a47d74b4f87ba15d414f1922d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:29.549428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9dcccf7c-e26e-44a1-9c20-ba78bb22dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:29.620220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1121/2232] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 18:59:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:32.643303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357efbe-52f6-4604-9f59-ad9ed116a1b2 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:32.643832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357efbe-52f6-4604-9f59-ad9ed116a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:32.643832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357efbe-52f6-4604-9f59-ad9ed116a1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:32.671748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a357efbe-52f6-4604-9f59-ad9ed116a1b2 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:32.673125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a357efbe-52f6-4604-9f59-ad9ed116a1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:32.687343 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1112/2233] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 4 18:59:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:32.701405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcccf7c-e26e-44a1-9c20-ba78bb22dadf None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:32.714606 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcccf7c-e26e-44a1-9c20-ba78bb22dadf None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:32.720475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883f6e0-2cea-4a6c-ac98-332eac33dd79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:32.721470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f6e0-2cea-4a6c-ac98-332eac33dd79 service swift] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:32.721928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f6e0-2cea-4a6c-ac98-332eac33dd79 service swift] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:32.722663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f6e0-2cea-4a6c-ac98-332eac33dd79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:32.731371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883f6e0-2cea-4a6c-ac98-332eac33dd79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:32.733017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883f6e0-2cea-4a6c-ac98-332eac33dd79 service swift] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:32.749166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1122/2234] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 18:59:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:59:35.182824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357efbe-52f6-4604-9f59-ad9ed116a1b2 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:35.184436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a357efbe-52f6-4604-9f59-ad9ed116a1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:35.295078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357efbe-52f6-4604-9f59-ad9ed116a1b2 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:35.300179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:35.301616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:35.301899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:35.302175 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] PATH_INFO: `/v3/users/b59093d4f76e4fdabe8e41440cf31f32` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:35.303419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59093d4f76e4fdabe8e41440cf31f32)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:35.305386 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:35.363073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59093d4f76e4fdabe8e41440cf31f32'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.370056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59093d4f76e4fdabe8e41440cf31f32'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.370700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59093d4f76e4fdabe8e41440cf31f32'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.371311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59093d4f76e4fdabe8e41440cf31f32'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.379587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59093d4f76e4fdabe8e41440cf31f32'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.395712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1113/2235] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 18:59:35 2022] DELETE /identity/v3/users/b59093d4f76e4fdabe8e41440cf31f32 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:59:35.567571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883f6e0-2cea-4a6c-ac98-332eac33dd79 service swift] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:35.577891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883f6e0-2cea-4a6c-ac98-332eac33dd79 service swift] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:35.638617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:35.639520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:35.639816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:35.640065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] PATH_INFO: `/v3/projects/648aeb6cd9384a51b759fe4fed0586a4` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:35.641219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=648aeb6cd9384a51b759fe4fed0586a4)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:35.643284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:35.692548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648aeb6cd9384a51b759fe4fed0586a4', 'request_id': 'req-5edc899e-e980-4bec-8af0-5e9d372ef6e0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.703094 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648aeb6cd9384a51b759fe4fed0586a4', 'request_id': 'req-5edc899e-e980-4bec-8af0-5e9d372ef6e0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.711354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648aeb6cd9384a51b759fe4fed0586a4', 'request_id': 'req-5edc899e-e980-4bec-8af0-5e9d372ef6e0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.721950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] The token cache is being invalidate because project 648aeb6cd9384a51b759fe4fed0586a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 18:59:35.722325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.723116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5edc899e-e980-4bec-8af0-5e9d372ef6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 18:59:35.724764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1123/2236] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 18:59:35 2022] DELETE /identity/v3/projects/648aeb6cd9384a51b759fe4fed0586a4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 18:59:45.081903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:45.083585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:45.164696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f66719-c2da-4ca8-8430-cfb7b0395aa5 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:45.212937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:45.213628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:45.213936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:45.214230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:45.216307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:45.280374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:45.281848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:45.291207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1114/2237] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:59:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 18:59:51.390471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93862528-b382-4cbc-9347-fca537311e68 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:51.390954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93862528-b382-4cbc-9347-fca537311e68 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:51.391056 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93862528-b382-4cbc-9347-fca537311e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:51.439543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-93862528-b382-4cbc-9347-fca537311e68 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 18:59:51.440765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-93862528-b382-4cbc-9347-fca537311e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:51.506336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1124/2238] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 18:59:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 18:59:51.521760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:51.523249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:51.613017 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343fb1-90fb-46c1-848f-77ce7f1f159b service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:51.620403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d63c4-3b4d-4692-8f96-06c235d5d0a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:51.621203 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d63c4-3b4d-4692-8f96-06c235d5d0a6 service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:51.621491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d63c4-3b4d-4692-8f96-06c235d5d0a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:51.621913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d63c4-3b4d-4692-8f96-06c235d5d0a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:51.635877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d63c4-3b4d-4692-8f96-06c235d5d0a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:51.637683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d63c4-3b4d-4692-8f96-06c235d5d0a6 service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:51.647767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1115/2239] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 18:59:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 18:59:55.549671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93862528-b382-4cbc-9347-fca537311e68 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 18:59:55.551263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-93862528-b382-4cbc-9347-fca537311e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:55.661704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93862528-b382-4cbc-9347-fca537311e68 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 18:59:55.668100 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724db5a-36c0-4013-94f7-846accff550f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6eaf63f68734bdd938aa0ea7d0c4441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 18:59:55.669000 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724db5a-36c0-4013-94f7-846accff550f service placement] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 18:59:55.669314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724db5a-36c0-4013-94f7-846accff550f service placement] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 18:59:55.669599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724db5a-36c0-4013-94f7-846accff550f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 18:59:55.671567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5724db5a-36c0-4013-94f7-846accff550f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 18:59:55.688225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724db5a-36c0-4013-94f7-846accff550f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 18:59:55.690415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724db5a-36c0-4013-94f7-846accff550f service placement] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 18:59:55.701261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1125/2240] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 18:59:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:05.099042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bd635-38b8-4f81-bd58-e9159a542522 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.099682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bd635-38b8-4f81-bd58-e9159a542522 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.099682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bd635-38b8-4f81-bd58-e9159a542522 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.101248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1116/2241] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 19:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:05.107278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc1769-bfb0-4daf-b190-ffb1a36120b2 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.107769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc1769-bfb0-4daf-b190-ffb1a36120b2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.107881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc1769-bfb0-4daf-b190-ffb1a36120b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.172171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-92bc1769-bfb0-4daf-b190-ffb1a36120b2 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:05.173542 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-92bc1769-bfb0-4daf-b190-ffb1a36120b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:05.253093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1126/2242] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 19:00:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:05.265041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bd635-38b8-4f81-bd58-e9159a542522 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:05.267045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-af5bd635-38b8-4f81-bd58-e9159a542522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:05.346365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bd635-38b8-4f81-bd58-e9159a542522 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:05.350236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcccbe-cae4-48b4-b3b7-2df6e30fcb77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63b338ae7e374ba5a7542c5a53deb416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:05.350887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcccbe-cae4-48b4-b3b7-2df6e30fcb77 service glance] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.351163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcccbe-cae4-48b4-b3b7-2df6e30fcb77 service glance] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.351440 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcccbe-cae4-48b4-b3b7-2df6e30fcb77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.362938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcccbe-cae4-48b4-b3b7-2df6e30fcb77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:05.364429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcccbe-cae4-48b4-b3b7-2df6e30fcb77 service glance] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:05.377196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1117/2243] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:00:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:05.447341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8a18-a607-4586-b22c-223b6e587da4 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.447557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8a18-a607-4586-b22c-223b6e587da4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.447816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8a18-a607-4586-b22c-223b6e587da4 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.449165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1127/2244] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 19:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:05.454116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bbc18-b90d-49f1-bf3f-0e3b843b03ac None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.454404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bbc18-b90d-49f1-bf3f-0e3b843b03ac None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.454705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bbc18-b90d-49f1-bf3f-0e3b843b03ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.474023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9a2bbc18-b90d-49f1-bf3f-0e3b843b03ac None None] MFA Rules not processed for user `94b338c27d664f51bc9de29c9c6ba40e`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:05.475215 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9a2bbc18-b90d-49f1-bf3f-0e3b843b03ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:05.488837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1118/2245] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 19:00:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:00:05.501947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8a18-a607-4586-b22c-223b6e587da4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:05.503942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c42b8a18-a607-4586-b22c-223b6e587da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:05.518822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8a18-a607-4586-b22c-223b6e587da4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:05.522941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd4c94-dc5b-48eb-858a-0496cc1dd1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:05.523590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd4c94-dc5b-48eb-858a-0496cc1dd1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.523870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd4c94-dc5b-48eb-858a-0496cc1dd1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.524170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd4c94-dc5b-48eb-858a-0496cc1dd1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.531453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd4c94-dc5b-48eb-858a-0496cc1dd1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:05.532950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd4c94-dc5b-48eb-858a-0496cc1dd1c2 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:05.540836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1128/2246] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:00:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:05.631319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9290a6-d26a-40ff-a65b-4ab97b9f5063 None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.631606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9290a6-d26a-40ff-a65b-4ab97b9f5063 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.631884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9290a6-d26a-40ff-a65b-4ab97b9f5063 None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.633319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1119/2247] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 19:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:00:05.638540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5da694-2a85-451c-9ec0-2b037762ae75 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.638900 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5da694-2a85-451c-9ec0-2b037762ae75 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.639179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5da694-2a85-451c-9ec0-2b037762ae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.658979 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-0a5da694-2a85-451c-9ec0-2b037762ae75 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:05.660184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0a5da694-2a85-451c-9ec0-2b037762ae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:05.670855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1129/2248] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 19:00:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:05.681552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9290a6-d26a-40ff-a65b-4ab97b9f5063 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:05.683577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ed9290a6-d26a-40ff-a65b-4ab97b9f5063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:05.698492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9290a6-d26a-40ff-a65b-4ab97b9f5063 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:05.702906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2037-1a04-41e1-b203-c5db56b6d672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:05.703567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2037-1a04-41e1-b203-c5db56b6d672 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:05.703838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2037-1a04-41e1-b203-c5db56b6d672 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:05.704113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2037-1a04-41e1-b203-c5db56b6d672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:05.714413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef2037-1a04-41e1-b203-c5db56b6d672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:05.715839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef2037-1a04-41e1-b203-c5db56b6d672 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:05.726282 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1120/2249] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:00:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:00:08.278401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94db7-5d94-4135-814d-4ff45be8f183 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:08.278943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94db7-5d94-4135-814d-4ff45be8f183 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:08.278943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94db7-5d94-4135-814d-4ff45be8f183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:08.298534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-73e94db7-5d94-4135-814d-4ff45be8f183 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:08.299758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-73e94db7-5d94-4135-814d-4ff45be8f183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:08.308129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1130/2250] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 19:00:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:08.320410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2037-1a04-41e1-b203-c5db56b6d672 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:08.332160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2037-1a04-41e1-b203-c5db56b6d672 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:08.338528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42fc3-a5bd-495b-a64c-9743327026c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:08.339170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42fc3-a5bd-495b-a64c-9743327026c5 service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:08.339464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42fc3-a5bd-495b-a64c-9743327026c5 service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:08.339709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42fc3-a5bd-495b-a64c-9743327026c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:08.348184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42fc3-a5bd-495b-a64c-9743327026c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:08.349867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42fc3-a5bd-495b-a64c-9743327026c5 service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:08.358175 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1121/2251] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:00:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:00:37.191709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb93e9c-e1d5-4f16-9e72-3f19fa19ee2b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:37.192271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb93e9c-e1d5-4f16-9e72-3f19fa19ee2b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:37.192271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb93e9c-e1d5-4f16-9e72-3f19fa19ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:37.211091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-0fb93e9c-e1d5-4f16-9e72-3f19fa19ee2b None None] MFA Rules not processed for user `c983699bd73f41fc813c41c498261ece`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:37.212397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0fb93e9c-e1d5-4f16-9e72-3f19fa19ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:37.269690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1131/2252] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:00:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:00:37.406955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea98fcd-463c-4eb5-b280-afd1d2098d13 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:37.407556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea98fcd-463c-4eb5-b280-afd1d2098d13 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:37.407556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea98fcd-463c-4eb5-b280-afd1d2098d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:37.425853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0ea98fcd-463c-4eb5-b280-afd1d2098d13 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:00:37.427053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0ea98fcd-463c-4eb5-b280-afd1d2098d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:00:37.434848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1122/2253] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 4 19:00:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:00:37.460232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb93e9c-e1d5-4f16-9e72-3f19fa19ee2b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:00:37.474798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb93e9c-e1d5-4f16-9e72-3f19fa19ee2b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:00:37.479738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addb39e-322d-4b22-b972-ad3b2180a28d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:00:37.480393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb39e-322d-4b22-b972-ad3b2180a28d service swift] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:00:37.480671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb39e-322d-4b22-b972-ad3b2180a28d service swift] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:00:37.480942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addb39e-322d-4b22-b972-ad3b2180a28d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:00:37.489342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addb39e-322d-4b22-b972-ad3b2180a28d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:00:37.490990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addb39e-322d-4b22-b972-ad3b2180a28d service swift] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:00:37.501031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1132/2254] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:00:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:01:13.357583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a85c0-c448-4eec-9d07-9d1817d80415 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:01:13.358157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a85c0-c448-4eec-9d07-9d1817d80415 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:01:13.358157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a85c0-c448-4eec-9d07-9d1817d80415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:01:13.377197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-701a85c0-c448-4eec-9d07-9d1817d80415 None None] MFA Rules not processed for user `c6dc233a47d74b4f87ba15d414f1922d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:01:13.378460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-701a85c0-c448-4eec-9d07-9d1817d80415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:01:13.439516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1123/2255] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:01:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:01:28.369891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebcfa-7ab9-4d6b-8775-c4375a456427 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:01:28.370476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebcfa-7ab9-4d6b-8775-c4375a456427 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:01:28.370572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebcfa-7ab9-4d6b-8775-c4375a456427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:01:28.389505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-98aebcfa-7ab9-4d6b-8775-c4375a456427 None None] MFA Rules not processed for user `b35f3684e2e648148e1273ad6f7b7cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:01:28.390820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-98aebcfa-7ab9-4d6b-8775-c4375a456427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:01:28.458560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1133/2256] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:01:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:01:28.708409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeb111-b8f1-4604-8921-f21e4ed40ef6 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:01:28.708945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeb111-b8f1-4604-8921-f21e4ed40ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:01:28.708945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeb111-b8f1-4604-8921-f21e4ed40ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:01:28.727473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-fbfeb111-b8f1-4604-8921-f21e4ed40ef6 None None] MFA Rules not processed for user `8c6f7ac9ef024f70bbc74961b4b7b7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:01:28.728730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-fbfeb111-b8f1-4604-8921-f21e4ed40ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:01:28.783020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1124/2257] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:01:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:01:47.927555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b09d-c522-4d1c-85b4-7fb29370fbc5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:01:47.928091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b09d-c522-4d1c-85b4-7fb29370fbc5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:01:47.928091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b09d-c522-4d1c-85b4-7fb29370fbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:01:47.951354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9635b09d-c522-4d1c-85b4-7fb29370fbc5 None None] MFA Rules not processed for user `c983699bd73f41fc813c41c498261ece`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:01:47.952575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9635b09d-c522-4d1c-85b4-7fb29370fbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:01:47.960601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1134/2258] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:01:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:01:53.196653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeb111-b8f1-4604-8921-f21e4ed40ef6 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:01:53.206942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeb111-b8f1-4604-8921-f21e4ed40ef6 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:01:53.211451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96d607-690a-47a3-8617-38f3eee326de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:01:53.212099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96d607-690a-47a3-8617-38f3eee326de service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:01:53.212379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96d607-690a-47a3-8617-38f3eee326de service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:01:53.212646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96d607-690a-47a3-8617-38f3eee326de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:01:53.214665 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cc96d607-690a-47a3-8617-38f3eee326de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:01:53.229023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96d607-690a-47a3-8617-38f3eee326de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:01:53.230515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96d607-690a-47a3-8617-38f3eee326de service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:01:53.245039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1125/2259] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:01:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:01:54.419910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635b09d-c522-4d1c-85b4-7fb29370fbc5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:01:54.431041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635b09d-c522-4d1c-85b4-7fb29370fbc5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:01:54.435767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddbd43-357f-4cdf-9a35-710a78fe460d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:01:54.436439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddbd43-357f-4cdf-9a35-710a78fe460d service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:01:54.436715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddbd43-357f-4cdf-9a35-710a78fe460d service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:01:54.436980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddbd43-357f-4cdf-9a35-710a78fe460d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:01:54.439101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a5ddbd43-357f-4cdf-9a35-710a78fe460d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:01:54.454080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddbd43-357f-4cdf-9a35-710a78fe460d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:01:54.455550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddbd43-357f-4cdf-9a35-710a78fe460d service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:01:54.466571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1135/2260] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:01:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:08.575165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96d607-690a-47a3-8617-38f3eee326de service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:08.584303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96d607-690a-47a3-8617-38f3eee326de service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:08.588991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b3823-6635-48a0-84ac-08a1429f7d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:08.589675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b3823-6635-48a0-84ac-08a1429f7d17 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:08.589960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b3823-6635-48a0-84ac-08a1429f7d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:08.590234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b3823-6635-48a0-84ac-08a1429f7d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:08.592318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c96b3823-6635-48a0-84ac-08a1429f7d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:08.602865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b3823-6635-48a0-84ac-08a1429f7d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:08.604299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b3823-6635-48a0-84ac-08a1429f7d17 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:08.612837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1126/2261] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:13.834297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62c17-0318-4275-904d-e3bd6c4a5208 None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:13.834867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62c17-0318-4275-904d-e3bd6c4a5208 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:13.835021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62c17-0318-4275-904d-e3bd6c4a5208 None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:13.836539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1136/2262] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 19:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:02:13.842779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2815c-a5ea-479c-9c8d-c4eaf5cf1368 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:13.843290 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2815c-a5ea-479c-9c8d-c4eaf5cf1368 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:13.843388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2815c-a5ea-479c-9c8d-c4eaf5cf1368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:13.863247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-f8d2815c-a5ea-479c-9c8d-c4eaf5cf1368 None None] MFA Rules not processed for user `94b338c27d664f51bc9de29c9c6ba40e`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:13.864517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f8d2815c-a5ea-479c-9c8d-c4eaf5cf1368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:13.872527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1127/2263] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 19:02:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:13.887461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62c17-0318-4275-904d-e3bd6c4a5208 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:13.900168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62c17-0318-4275-904d-e3bd6c4a5208 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:13.903781 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb47947-9ff6-479c-8d62-baf94580af6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:13.904428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb47947-9ff6-479c-8d62-baf94580af6d service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:13.904750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb47947-9ff6-479c-8d62-baf94580af6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:13.905025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb47947-9ff6-479c-8d62-baf94580af6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:13.912930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb47947-9ff6-479c-8d62-baf94580af6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:13.915078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb47947-9ff6-479c-8d62-baf94580af6d service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:13.925082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1137/2264] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:14.006116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc642d20-35bb-4a4c-86d1-93dbc041a99a None None] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:14.006395 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc642d20-35bb-4a4c-86d1-93dbc041a99a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:14.006666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc642d20-35bb-4a4c-86d1-93dbc041a99a None None] PATH_INFO: `/` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:14.008065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1128/2265] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 19:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:02:14.014451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1f05-7534-4ee4-aee7-58d3e5895b2b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:14.014886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1f05-7534-4ee4-aee7-58d3e5895b2b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:14.015185 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1f05-7534-4ee4-aee7-58d3e5895b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:14.034783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5f4f1f05-7534-4ee4-aee7-58d3e5895b2b None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:14.035994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5f4f1f05-7534-4ee4-aee7-58d3e5895b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:14.045428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1138/2266] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 19:02:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:14.061217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc642d20-35bb-4a4c-86d1-93dbc041a99a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:14.073400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc642d20-35bb-4a4c-86d1-93dbc041a99a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:14.077991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551cc7b-49b9-462f-a947-51977aa90cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:14.078630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551cc7b-49b9-462f-a947-51977aa90cda service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:14.078907 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551cc7b-49b9-462f-a947-51977aa90cda service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:14.079172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551cc7b-49b9-462f-a947-51977aa90cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:14.090850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551cc7b-49b9-462f-a947-51977aa90cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:14.092270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551cc7b-49b9-462f-a947-51977aa90cda service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:14.103161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1129/2267] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:14.173932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f1f05-7534-4ee4-aee7-58d3e5895b2b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:14.175892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5f4f1f05-7534-4ee4-aee7-58d3e5895b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:14.190564 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f1f05-7534-4ee4-aee7-58d3e5895b2b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:14.196968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b212f-26f3-4b8b-93c4-e47b9254f6aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6eaf63f68734bdd938aa0ea7d0c4441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:14.197646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b212f-26f3-4b8b-93c4-e47b9254f6aa service placement] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:14.197919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b212f-26f3-4b8b-93c4-e47b9254f6aa service placement] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:14.198199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b212f-26f3-4b8b-93c4-e47b9254f6aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:14.200257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e25b212f-26f3-4b8b-93c4-e47b9254f6aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:14.211634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b212f-26f3-4b8b-93c4-e47b9254f6aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:14.213205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b212f-26f3-4b8b-93c4-e47b9254f6aa service placement] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:14.222850 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1139/2268] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:15.975419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551cc7b-49b9-462f-a947-51977aa90cda service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:15.977400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6551cc7b-49b9-462f-a947-51977aa90cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:15.992409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551cc7b-49b9-462f-a947-51977aa90cda service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:15.998305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:15.998994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:15.999269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:15.999541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:16.001605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:16.012733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:16.014400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:16.023811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1130/2269] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:19.586205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b212f-26f3-4b8b-93c4-e47b9254f6aa service placement] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:19.595429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b212f-26f3-4b8b-93c4-e47b9254f6aa service placement] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:19.599017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41081b64-a4c7-4bcb-b000-d281efdada6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:19.599680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41081b64-a4c7-4bcb-b000-d281efdada6f service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:19.599956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41081b64-a4c7-4bcb-b000-d281efdada6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:19.600244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41081b64-a4c7-4bcb-b000-d281efdada6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:19.601969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-41081b64-a4c7-4bcb-b000-d281efdada6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:19.667096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41081b64-a4c7-4bcb-b000-d281efdada6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:19.668561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41081b64-a4c7-4bcb-b000-d281efdada6f service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:19.679010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1140/2270] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:23.127096 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:23.128514 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:23.142487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44109dbd-da14-442b-a256-7c81c70ab1a2 service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:23.147182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:23.148067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:23.148349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:23.148626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] PATH_INFO: `/v3/users/c6dc233a47d74b4f87ba15d414f1922d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:23.149864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6dc233a47d74b4f87ba15d414f1922d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:23.151796 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:23.200779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6dc233a47d74b4f87ba15d414f1922d'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.208045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6dc233a47d74b4f87ba15d414f1922d'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.208734 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6dc233a47d74b4f87ba15d414f1922d'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.209338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6dc233a47d74b4f87ba15d414f1922d'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.217460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-91c80056-7700-4d41-adce-150fa7c056d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6dc233a47d74b4f87ba15d414f1922d'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.234742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1131/2271] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:02:23 2022] DELETE /identity/v3/users/c6dc233a47d74b4f87ba15d414f1922d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:23.406035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41081b64-a4c7-4bcb-b000-d281efdada6f service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:23.425238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41081b64-a4c7-4bcb-b000-d281efdada6f service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:23.507079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:23.507958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:23.508242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:23.508515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] PATH_INFO: `/v3/projects/5287a76e646d4a3db0cc508a956314e7` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:23.509739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5287a76e646d4a3db0cc508a956314e7)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:23.511647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:23.556297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5287a76e646d4a3db0cc508a956314e7', 'request_id': 'req-2aceadf4-fad3-48bf-8937-56f7637d8628'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.563424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5287a76e646d4a3db0cc508a956314e7', 'request_id': 'req-2aceadf4-fad3-48bf-8937-56f7637d8628'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.569620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5287a76e646d4a3db0cc508a956314e7', 'request_id': 'req-2aceadf4-fad3-48bf-8937-56f7637d8628'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.579974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] The token cache is being invalidate because project 5287a76e646d4a3db0cc508a956314e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:02:23.580258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.580879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2aceadf4-fad3-48bf-8937-56f7637d8628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:23.582738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1141/2272] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:02:23 2022] DELETE /identity/v3/projects/5287a76e646d4a3db0cc508a956314e7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:23.592989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba264c-9716-45b5-a45c-5a2644b63631 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:23.593276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba264c-9716-45b5-a45c-5a2644b63631 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:23.593604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba264c-9716-45b5-a45c-5a2644b63631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:23.638204 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-2dba264c-9716-45b5-a45c-5a2644b63631 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:23.639403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2dba264c-9716-45b5-a45c-5a2644b63631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:23.697663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1132/2273] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:23.705660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3554-7f11-44f3-bde0-c7c49f292828 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:23.705942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3554-7f11-44f3-bde0-c7c49f292828 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:23.706214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3554-7f11-44f3-bde0-c7c49f292828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:23.725109 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-54de3554-7f11-44f3-bde0-c7c49f292828 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:23.726359 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-54de3554-7f11-44f3-bde0-c7c49f292828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:23.735269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1142/2274] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:23.740176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba264c-9716-45b5-a45c-5a2644b63631 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:23.754735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba264c-9716-45b5-a45c-5a2644b63631 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:23.761492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e33124-383e-4053-8660-9ca0a27dc55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:23.762156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e33124-383e-4053-8660-9ca0a27dc55a admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:23.762438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e33124-383e-4053-8660-9ca0a27dc55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:23.762994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e33124-383e-4053-8660-9ca0a27dc55a admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:23.763714 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e33124-383e-4053-8660-9ca0a27dc55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:02:23.764033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e33124-383e-4053-8660-9ca0a27dc55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:23.766230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e33124-383e-4053-8660-9ca0a27dc55a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:23.779040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1133/2275] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:02:23.785813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de3554-7f11-44f3-bde0-c7c49f292828 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:23.795487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de3554-7f11-44f3-bde0-c7c49f292828 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:23.801076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd90495-635a-45ad-a2c9-098bed4d43bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:23.801767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd90495-635a-45ad-a2c9-098bed4d43bb admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:23.802050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd90495-635a-45ad-a2c9-098bed4d43bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:23.802327 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd90495-635a-45ad-a2c9-098bed4d43bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:23.803019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd90495-635a-45ad-a2c9-098bed4d43bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:23.804989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd90495-635a-45ad-a2c9-098bed4d43bb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:23.831517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1143/2276] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:02:23 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:23.835668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e33124-383e-4053-8660-9ca0a27dc55a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:23.845208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e33124-383e-4053-8660-9ca0a27dc55a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:23.903747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14a7f9-7e78-462e-93e0-cf088f85f9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:23.904417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a7f9-7e78-462e-93e0-cf088f85f9dd admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:23.904695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a7f9-7e78-462e-93e0-cf088f85f9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:23.904968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a7f9-7e78-462e-93e0-cf088f85f9dd admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:23.905700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14a7f9-7e78-462e-93e0-cf088f85f9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:23.907617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14a7f9-7e78-462e-93e0-cf088f85f9dd admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:23.929124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1134/2277] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:02:23 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:02:23.933472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd90495-635a-45ad-a2c9-098bed4d43bb admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:23.944124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd90495-635a-45ad-a2c9-098bed4d43bb admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:23.949394 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc6d65-f7d2-4a97-a2b2-e2890969249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:23.950101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6d65-f7d2-4a97-a2b2-e2890969249b admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:23.950380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6d65-f7d2-4a97-a2b2-e2890969249b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:23.950652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6d65-f7d2-4a97-a2b2-e2890969249b admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:23.951463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc6d65-f7d2-4a97-a2b2-e2890969249b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:23.953072 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc6d65-f7d2-4a97-a2b2-e2890969249b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:23.963376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1144/2278] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:23.967244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14a7f9-7e78-462e-93e0-cf088f85f9dd admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:23.977311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14a7f9-7e78-462e-93e0-cf088f85f9dd admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:23.982661 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05d42c-6e02-4856-bed4-00f09104830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:23.983320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05d42c-6e02-4856-bed4-00f09104830d admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:23.983593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05d42c-6e02-4856-bed4-00f09104830d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:23.983864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05d42c-6e02-4856-bed4-00f09104830d admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:23.984588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05d42c-6e02-4856-bed4-00f09104830d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:23.986201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05d42c-6e02-4856-bed4-00f09104830d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:23.996669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1135/2279] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:02:24.000881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc6d65-f7d2-4a97-a2b2-e2890969249b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:24.011319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc6d65-f7d2-4a97-a2b2-e2890969249b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:24.016438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41188f83-7282-438c-9cbd-ce973d36ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:24.017337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41188f83-7282-438c-9cbd-ce973d36ed01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:24.017634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41188f83-7282-438c-9cbd-ce973d36ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:24.017919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41188f83-7282-438c-9cbd-ce973d36ed01 admin admin] PATH_INFO: `/v3/projects/2e818fd7cdc1493f821f676c558f8f3c/users/fed752463c6645f497bf377b89baca18/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:24.033203 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41188f83-7282-438c-9cbd-ce973d36ed01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e818fd7cdc1493f821f676c558f8f3c, user_id=fed752463c6645f497bf377b89baca18, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:24.035987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41188f83-7282-438c-9cbd-ce973d36ed01 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:24.051759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1145/2280] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:23 2022] PUT /identity/v3/projects/2e818fd7cdc1493f821f676c558f8f3c/users/fed752463c6645f497bf377b89baca18/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:24.057033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e4a60-b3c6-4911-89ce-f9531666a43f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:24.057263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e4a60-b3c6-4911-89ce-f9531666a43f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:24.057571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e4a60-b3c6-4911-89ce-f9531666a43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:24.075974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3a8e4a60-b3c6-4911-89ce-f9531666a43f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:24.077169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3a8e4a60-b3c6-4911-89ce-f9531666a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:24.135377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1136/2281] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:24.145198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41188f83-7282-438c-9cbd-ce973d36ed01 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:24.147381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-41188f83-7282-438c-9cbd-ce973d36ed01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:24.206323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41188f83-7282-438c-9cbd-ce973d36ed01 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:24.211137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797865e-7ebd-47f2-8d5c-9a4627c33afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:24.211782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797865e-7ebd-47f2-8d5c-9a4627c33afd service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:24.212053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797865e-7ebd-47f2-8d5c-9a4627c33afd service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:24.212319 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797865e-7ebd-47f2-8d5c-9a4627c33afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:24.222271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797865e-7ebd-47f2-8d5c-9a4627c33afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:24.223740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797865e-7ebd-47f2-8d5c-9a4627c33afd service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:24.233143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1146/2282] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:24.659492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e4a60-b3c6-4911-89ce-f9531666a43f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:24.661651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3a8e4a60-b3c6-4911-89ce-f9531666a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:24.741116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e4a60-b3c6-4911-89ce-f9531666a43f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:24.752098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4b4f-18b1-4f5c-8d59-8618608c5b0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:24.752812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4b4f-18b1-4f5c-8d59-8618608c5b0e service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:24.753092 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4b4f-18b1-4f5c-8d59-8618608c5b0e service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:24.753391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4b4f-18b1-4f5c-8d59-8618608c5b0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:24.755783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ac5e4b4f-18b1-4f5c-8d59-8618608c5b0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:24.814338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e4b4f-18b1-4f5c-8d59-8618608c5b0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:24.816034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e4b4f-18b1-4f5c-8d59-8618608c5b0e service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:24.827235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1137/2283] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:24.833771 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441d767-200b-477f-a768-613379e0af5c None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:24.834162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441d767-200b-477f-a768-613379e0af5c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:24.834320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441d767-200b-477f-a768-613379e0af5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:24.861476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-7441d767-200b-477f-a768-613379e0af5c None None] MFA Rules not processed for user `fed752463c6645f497bf377b89baca18`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:24.862730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-7441d767-200b-477f-a768-613379e0af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:24.946082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1147/2284] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:24.947537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4b4f-18b1-4f5c-8d59-8618608c5b0e service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:24.958261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4b4f-18b1-4f5c-8d59-8618608c5b0e service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:24.962992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1e93b-21d5-4b6d-a556-4bd462b1e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:24.963895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1e93b-21d5-4b6d-a556-4bd462b1e2df admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:24.964201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1e93b-21d5-4b6d-a556-4bd462b1e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:24.964470 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1e93b-21d5-4b6d-a556-4bd462b1e2df admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:24.965177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1e93b-21d5-4b6d-a556-4bd462b1e2df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:24.967263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1e93b-21d5-4b6d-a556-4bd462b1e2df admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:25.001459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1138/2285] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:02:24 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:25.002620 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441d767-200b-477f-a768-613379e0af5c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:25.014298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441d767-200b-477f-a768-613379e0af5c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:25.072011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247033ab-af14-4467-8180-29870319044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:25.072651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247033ab-af14-4467-8180-29870319044d admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:25.073180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247033ab-af14-4467-8180-29870319044d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:25.073349 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247033ab-af14-4467-8180-29870319044d admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:25.074019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247033ab-af14-4467-8180-29870319044d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:25.076040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247033ab-af14-4467-8180-29870319044d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:25.104170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1148/2286] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:02:25 2022] POST /identity/v3/users => generated 308 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:25.108179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1e93b-21d5-4b6d-a556-4bd462b1e2df admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:25.119668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1e93b-21d5-4b6d-a556-4bd462b1e2df admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:25.124965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8638e98-8b90-4f17-8741-8ec169d1d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:25.125727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8638e98-8b90-4f17-8741-8ec169d1d5ae admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:25.126124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8638e98-8b90-4f17-8741-8ec169d1d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:25.126456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8638e98-8b90-4f17-8741-8ec169d1d5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:25.127253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8638e98-8b90-4f17-8741-8ec169d1d5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:25.128888 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8638e98-8b90-4f17-8741-8ec169d1d5ae admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:25.142562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1139/2287] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:02:25.144894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247033ab-af14-4467-8180-29870319044d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:25.154632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247033ab-af14-4467-8180-29870319044d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:25.159361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed470-18ab-4c92-91d6-1d84d4e6582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:25.160304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed470-18ab-4c92-91d6-1d84d4e6582d admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:25.160585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed470-18ab-4c92-91d6-1d84d4e6582d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:25.160861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed470-18ab-4c92-91d6-1d84d4e6582d admin admin] PATH_INFO: `/v3/projects/082bbf48c4d84badb0f76dd52b861995/users/cc9e4317b3944330b49e8978cada69bb/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:25.176624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ed470-18ab-4c92-91d6-1d84d4e6582d admin admin] RBAC: Authorizing `identity:create_grant(project_id=082bbf48c4d84badb0f76dd52b861995, user_id=cc9e4317b3944330b49e8978cada69bb, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:25.179353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ed470-18ab-4c92-91d6-1d84d4e6582d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:25.193251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1149/2288] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:25 2022] PUT /identity/v3/projects/082bbf48c4d84badb0f76dd52b861995/users/cc9e4317b3944330b49e8978cada69bb/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:02:25.197214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8638e98-8b90-4f17-8741-8ec169d1d5ae admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:25.207398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8638e98-8b90-4f17-8741-8ec169d1d5ae admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:25.268919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df075f-0e19-4c61-aed3-d72feb054518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:25.269743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df075f-0e19-4c61-aed3-d72feb054518 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:25.270069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df075f-0e19-4c61-aed3-d72feb054518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:25.270341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df075f-0e19-4c61-aed3-d72feb054518 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:25.271085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df075f-0e19-4c61-aed3-d72feb054518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:25.272687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df075f-0e19-4c61-aed3-d72feb054518 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:25.283377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1140/2289] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:25.287772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed470-18ab-4c92-91d6-1d84d4e6582d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:25.298303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed470-18ab-4c92-91d6-1d84d4e6582d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:25.303222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cef64a-ad72-4e30-b971-f12d09ddef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:25.304116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef64a-ad72-4e30-b971-f12d09ddef0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:25.304399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef64a-ad72-4e30-b971-f12d09ddef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:25.304672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef64a-ad72-4e30-b971-f12d09ddef0e admin admin] PATH_INFO: `/v3/projects/082bbf48c4d84badb0f76dd52b861995/users/cc9e4317b3944330b49e8978cada69bb/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:25.306686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cef64a-ad72-4e30-b971-f12d09ddef0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=082bbf48c4d84badb0f76dd52b861995, user_id=cc9e4317b3944330b49e8978cada69bb, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:25.309364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cef64a-ad72-4e30-b971-f12d09ddef0e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:25.320223 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1150/2290] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:25 2022] PUT /identity/v3/projects/082bbf48c4d84badb0f76dd52b861995/users/cc9e4317b3944330b49e8978cada69bb/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:26.198120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb23bd-125c-4abf-a459-d5705035d954 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:26.200095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb23bd-125c-4abf-a459-d5705035d954 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:26.200559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb23bd-125c-4abf-a459-d5705035d954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:26.234675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3edb23bd-125c-4abf-a459-d5705035d954 None None] MFA Rules not processed for user `cc9e4317b3944330b49e8978cada69bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:26.236009 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3edb23bd-125c-4abf-a459-d5705035d954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:26.309823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1141/2291] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:27.332346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cef64a-ad72-4e30-b971-f12d09ddef0e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:27.396834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cef64a-ad72-4e30-b971-f12d09ddef0e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:27.401593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:27.402478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:27.402763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:27.403043 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] PATH_INFO: `/v3/users/fed752463c6645f497bf377b89baca18` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:27.404262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed752463c6645f497bf377b89baca18)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:27.406233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:27.456898 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed752463c6645f497bf377b89baca18'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.464133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed752463c6645f497bf377b89baca18'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.464886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed752463c6645f497bf377b89baca18'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.465613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed752463c6645f497bf377b89baca18'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.475074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed752463c6645f497bf377b89baca18'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.492948 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1151/2292] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:02:27 2022] DELETE /identity/v3/users/fed752463c6645f497bf377b89baca18 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:27.665789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb23bd-125c-4abf-a459-d5705035d954 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:27.676327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb23bd-125c-4abf-a459-d5705035d954 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:27.732925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:27.733746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:27.734020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:27.734294 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] PATH_INFO: `/v3/projects/2e818fd7cdc1493f821f676c558f8f3c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:27.735482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e818fd7cdc1493f821f676c558f8f3c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:27.737428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:27.786927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e818fd7cdc1493f821f676c558f8f3c', 'request_id': 'req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.792844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e818fd7cdc1493f821f676c558f8f3c', 'request_id': 'req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.801789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e818fd7cdc1493f821f676c558f8f3c', 'request_id': 'req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.811743 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] The token cache is being invalidate because project 2e818fd7cdc1493f821f676c558f8f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:02:27.812026 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.812641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.814244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1142/2293] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:02:27 2022] DELETE /identity/v3/projects/2e818fd7cdc1493f821f676c558f8f3c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:27.818559 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:27.820178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:27.833109 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a1cf-7678-4aed-aabe-7429a9e2fa76 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:27.890880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:27.892115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:27.892495 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:27.892844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] PATH_INFO: `/v3/users/cc9e4317b3944330b49e8978cada69bb` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:27.894168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9e4317b3944330b49e8978cada69bb)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:27.896229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:27.943702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9e4317b3944330b49e8978cada69bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.950487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9e4317b3944330b49e8978cada69bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.951224 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9e4317b3944330b49e8978cada69bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.951876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9e4317b3944330b49e8978cada69bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.960552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e95f3482-59c2-49d1-94b6-97a9b58966c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9e4317b3944330b49e8978cada69bb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:27.978045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1152/2294] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:02:27 2022] DELETE /identity/v3/users/cc9e4317b3944330b49e8978cada69bb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:28.164037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:28.173741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:28.186392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8646b-3ef3-4e7f-ba10-bd3327eaae5e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:28.245426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:28.246322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.246592 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.246868 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] PATH_INFO: `/v3/projects/082bbf48c4d84badb0f76dd52b861995` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.248053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=082bbf48c4d84badb0f76dd52b861995)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:28.249995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:28.303305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082bbf48c4d84badb0f76dd52b861995', 'request_id': 'req-2d669f6b-0dfa-4529-b726-dbe235dce3ce'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:28.309385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082bbf48c4d84badb0f76dd52b861995', 'request_id': 'req-2d669f6b-0dfa-4529-b726-dbe235dce3ce'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:28.317625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082bbf48c4d84badb0f76dd52b861995', 'request_id': 'req-2d669f6b-0dfa-4529-b726-dbe235dce3ce'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:28.328322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] The token cache is being invalidate because project 082bbf48c4d84badb0f76dd52b861995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:02:28.328607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:28.329222 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-2d669f6b-0dfa-4529-b726-dbe235dce3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:28.331074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1143/2295] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:02:28 2022] DELETE /identity/v3/projects/082bbf48c4d84badb0f76dd52b861995 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:28.336894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da760f0-2793-4292-9019-af608039e0c7 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.337412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da760f0-2793-4292-9019-af608039e0c7 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.337504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da760f0-2793-4292-9019-af608039e0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.356416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-1da760f0-2793-4292-9019-af608039e0c7 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:28.357659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1da760f0-2793-4292-9019-af608039e0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:28.415782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1153/2296] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:28.423840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ebfc-15c2-4f10-9cfb-f0ef749a1927 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.424125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ebfc-15c2-4f10-9cfb-f0ef749a1927 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.424371 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ebfc-15c2-4f10-9cfb-f0ef749a1927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.443302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-aa70ebfc-15c2-4f10-9cfb-f0ef749a1927 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:28.444510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-aa70ebfc-15c2-4f10-9cfb-f0ef749a1927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:28.456041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1144/2297] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:28.459193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da760f0-2793-4292-9019-af608039e0c7 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:28.468879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da760f0-2793-4292-9019-af608039e0c7 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:28.473627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0d1c-4b09-4012-92dd-63c97ebae155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:28.474342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0d1c-4b09-4012-92dd-63c97ebae155 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.474622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0d1c-4b09-4012-92dd-63c97ebae155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.474894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0d1c-4b09-4012-92dd-63c97ebae155 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.475629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0d1c-4b09-4012-92dd-63c97ebae155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:02:28.475935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0d1c-4b09-4012-92dd-63c97ebae155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:28.477575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0d1c-4b09-4012-92dd-63c97ebae155 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:28.489423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1154/2298] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:02:28.493818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ebfc-15c2-4f10-9cfb-f0ef749a1927 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:28.502950 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ebfc-15c2-4f10-9cfb-f0ef749a1927 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:28.507668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee91c2-aff8-4564-a532-d65fcda650f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:28.508332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee91c2-aff8-4564-a532-d65fcda650f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.508597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee91c2-aff8-4564-a532-d65fcda650f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.508874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee91c2-aff8-4564-a532-d65fcda650f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.509672 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee91c2-aff8-4564-a532-d65fcda650f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:28.511645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee91c2-aff8-4564-a532-d65fcda650f8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:28.539774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1145/2299] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:02:28 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:28.542195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0d1c-4b09-4012-92dd-63c97ebae155 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:28.552062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0d1c-4b09-4012-92dd-63c97ebae155 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:28.606949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04528464-07c0-4c63-8f2b-032991a0d2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:28.607622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528464-07c0-4c63-8f2b-032991a0d2dc admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.607995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528464-07c0-4c63-8f2b-032991a0d2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.608275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528464-07c0-4c63-8f2b-032991a0d2dc admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.609077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04528464-07c0-4c63-8f2b-032991a0d2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:28.610909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04528464-07c0-4c63-8f2b-032991a0d2dc admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:28.636435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1155/2300] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:02:28 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:28.636643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee91c2-aff8-4564-a532-d65fcda650f8 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:28.647289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee91c2-aff8-4564-a532-d65fcda650f8 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:28.652615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f334-0d87-4093-9fcf-6c4f1673aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:28.653348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f334-0d87-4093-9fcf-6c4f1673aaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.653632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f334-0d87-4093-9fcf-6c4f1673aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.653909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f334-0d87-4093-9fcf-6c4f1673aaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.654674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f334-0d87-4093-9fcf-6c4f1673aaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:28.656265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f334-0d87-4093-9fcf-6c4f1673aaa3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:28.670085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1146/2301] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:28.671337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04528464-07c0-4c63-8f2b-032991a0d2dc admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:28.681944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04528464-07c0-4c63-8f2b-032991a0d2dc admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:28.687401 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5245342-6fe3-4229-8ed8-7aa7aa4196a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:28.688050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5245342-6fe3-4229-8ed8-7aa7aa4196a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.688340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5245342-6fe3-4229-8ed8-7aa7aa4196a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.688615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5245342-6fe3-4229-8ed8-7aa7aa4196a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.689419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5245342-6fe3-4229-8ed8-7aa7aa4196a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:28.691076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5245342-6fe3-4229-8ed8-7aa7aa4196a3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:28.703929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1156/2302] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:28.710380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f334-0d87-4093-9fcf-6c4f1673aaa3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:28.720409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f334-0d87-4093-9fcf-6c4f1673aaa3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:28.725335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ab763-8000-492f-93b8-93bac1ac597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:28.726136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ab763-8000-492f-93b8-93bac1ac597d admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.726419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ab763-8000-492f-93b8-93bac1ac597d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.726696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ab763-8000-492f-93b8-93bac1ac597d admin admin] PATH_INFO: `/v3/projects/13d0457f711d40b9994fcf2476ca312b/users/71b3c369f81e433a9fdb05b9ac554979/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.741694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ab763-8000-492f-93b8-93bac1ac597d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d0457f711d40b9994fcf2476ca312b, user_id=71b3c369f81e433a9fdb05b9ac554979, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:28.744359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ab763-8000-492f-93b8-93bac1ac597d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:28.758017 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1147/2303] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:28 2022] PUT /identity/v3/projects/13d0457f711d40b9994fcf2476ca312b/users/71b3c369f81e433a9fdb05b9ac554979/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:28.768887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b6fe5-3455-48e5-88f6-56b660aa455c None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.769228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b6fe5-3455-48e5-88f6-56b660aa455c None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.769536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b6fe5-3455-48e5-88f6-56b660aa455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.795309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-927b6fe5-3455-48e5-88f6-56b660aa455c None None] MFA Rules not processed for user `71b3c369f81e433a9fdb05b9ac554979`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:28.796498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-927b6fe5-3455-48e5-88f6-56b660aa455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:28.871298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1157/2304] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:02:28.876525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ab763-8000-492f-93b8-93bac1ac597d admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:28.943016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ab763-8000-492f-93b8-93bac1ac597d admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:28.952474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b8e59-fcec-490c-b63f-75826ed52bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:28.953409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b8e59-fcec-490c-b63f-75826ed52bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:28.953682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b8e59-fcec-490c-b63f-75826ed52bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:28.953989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b8e59-fcec-490c-b63f-75826ed52bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:28.954694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b8e59-fcec-490c-b63f-75826ed52bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:28.956516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b8e59-fcec-490c-b63f-75826ed52bd3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:28.985949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1148/2305] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:02:28 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:28.987601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b6fe5-3455-48e5-88f6-56b660aa455c None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:28.998540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b6fe5-3455-48e5-88f6-56b660aa455c None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:29.053965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91983a-f60c-4fde-88ea-9dc0fd4dd5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:29.054768 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91983a-f60c-4fde-88ea-9dc0fd4dd5dc admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:29.055071 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91983a-f60c-4fde-88ea-9dc0fd4dd5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:29.055353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91983a-f60c-4fde-88ea-9dc0fd4dd5dc admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:29.056066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91983a-f60c-4fde-88ea-9dc0fd4dd5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:29.058376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91983a-f60c-4fde-88ea-9dc0fd4dd5dc admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:29.083776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1158/2306] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:02:28 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:29.085006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b8e59-fcec-490c-b63f-75826ed52bd3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:29.095178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b8e59-fcec-490c-b63f-75826ed52bd3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:29.099852 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826a3f4-0a85-4739-b0b1-2ca0db2011fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:29.100504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826a3f4-0a85-4739-b0b1-2ca0db2011fc admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:29.100785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826a3f4-0a85-4739-b0b1-2ca0db2011fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:29.101058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826a3f4-0a85-4739-b0b1-2ca0db2011fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:29.101845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826a3f4-0a85-4739-b0b1-2ca0db2011fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:29.103444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826a3f4-0a85-4739-b0b1-2ca0db2011fc admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:29.113512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1149/2307] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:02:29.118081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91983a-f60c-4fde-88ea-9dc0fd4dd5dc admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:29.128253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91983a-f60c-4fde-88ea-9dc0fd4dd5dc admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:29.133756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b923d30-4ab6-4944-949f-0e749ad5c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:29.134644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b923d30-4ab6-4944-949f-0e749ad5c189 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:29.134923 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b923d30-4ab6-4944-949f-0e749ad5c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:29.135196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b923d30-4ab6-4944-949f-0e749ad5c189 admin admin] PATH_INFO: `/v3/projects/d39283e875524aa096ec5276c1e58061/users/48b934c36e614932b3671720638fbede/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:29.157063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b923d30-4ab6-4944-949f-0e749ad5c189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39283e875524aa096ec5276c1e58061, user_id=48b934c36e614932b3671720638fbede, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:29.161418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b923d30-4ab6-4944-949f-0e749ad5c189 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:29.177125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1159/2308] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:29 2022] PUT /identity/v3/projects/d39283e875524aa096ec5276c1e58061/users/48b934c36e614932b3671720638fbede/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:02:29.182321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826a3f4-0a85-4739-b0b1-2ca0db2011fc admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:29.195943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826a3f4-0a85-4739-b0b1-2ca0db2011fc admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:29.251379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9decb2-591c-4daa-9eb0-a11d45a6dcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:29.252053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9decb2-591c-4daa-9eb0-a11d45a6dcbc admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:29.252341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9decb2-591c-4daa-9eb0-a11d45a6dcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:29.252618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9decb2-591c-4daa-9eb0-a11d45a6dcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:29.253397 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9decb2-591c-4daa-9eb0-a11d45a6dcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:29.255106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9decb2-591c-4daa-9eb0-a11d45a6dcbc admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:29.264540 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1150/2309] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:29.269355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b923d30-4ab6-4944-949f-0e749ad5c189 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:29.284081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b923d30-4ab6-4944-949f-0e749ad5c189 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:29.290301 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d6432-2c2f-4bc9-8c43-8ba4f03131e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:29.291189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d6432-2c2f-4bc9-8c43-8ba4f03131e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:29.291466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d6432-2c2f-4bc9-8c43-8ba4f03131e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:29.291735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d6432-2c2f-4bc9-8c43-8ba4f03131e9 admin admin] PATH_INFO: `/v3/projects/d39283e875524aa096ec5276c1e58061/users/48b934c36e614932b3671720638fbede/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:29.293853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d6432-2c2f-4bc9-8c43-8ba4f03131e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39283e875524aa096ec5276c1e58061, user_id=48b934c36e614932b3671720638fbede, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:29.296481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d6432-2c2f-4bc9-8c43-8ba4f03131e9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:29.308772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1160/2310] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:29 2022] PUT /identity/v3/projects/d39283e875524aa096ec5276c1e58061/users/48b934c36e614932b3671720638fbede/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:29.320537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e181c04-e2e5-45c0-81ed-5bd8adccb28a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:29.320812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e181c04-e2e5-45c0-81ed-5bd8adccb28a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:29.321087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e181c04-e2e5-45c0-81ed-5bd8adccb28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:29.347735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3e181c04-e2e5-45c0-81ed-5bd8adccb28a None None] MFA Rules not processed for user `48b934c36e614932b3671720638fbede`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:29.349196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3e181c04-e2e5-45c0-81ed-5bd8adccb28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:29.417032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1151/2311] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:29.428526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d6432-2c2f-4bc9-8c43-8ba4f03131e9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:29.430506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ad6d6432-2c2f-4bc9-8c43-8ba4f03131e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:29.508139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d6432-2c2f-4bc9-8c43-8ba4f03131e9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:29.512505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43c33-3df8-4848-a9bf-0497e319203e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:29.513142 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43c33-3df8-4848-a9bf-0497e319203e service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:29.513450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43c33-3df8-4848-a9bf-0497e319203e service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:29.513718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43c33-3df8-4848-a9bf-0497e319203e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:29.523230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce43c33-3df8-4848-a9bf-0497e319203e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:29.524648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce43c33-3df8-4848-a9bf-0497e319203e service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:29.534805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1161/2312] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:29.617452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e181c04-e2e5-45c0-81ed-5bd8adccb28a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:29.627134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e181c04-e2e5-45c0-81ed-5bd8adccb28a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:29.631206 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633c04c-93f3-497d-967c-aadc189b8b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:29.631863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633c04c-93f3-497d-967c-aadc189b8b8a service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:29.632157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633c04c-93f3-497d-967c-aadc189b8b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:29.632426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633c04c-93f3-497d-967c-aadc189b8b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:29.689316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633c04c-93f3-497d-967c-aadc189b8b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:29.690770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633c04c-93f3-497d-967c-aadc189b8b8a service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:29.699671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1152/2313] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:30.068461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43c33-3df8-4848-a9bf-0497e319203e service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:30.070170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-dce43c33-3df8-4848-a9bf-0497e319203e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:30.144471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43c33-3df8-4848-a9bf-0497e319203e service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:30.150230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58daee2a-5d8d-4519-a67f-0809df7bbc20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:30.150883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58daee2a-5d8d-4519-a67f-0809df7bbc20 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:30.151159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58daee2a-5d8d-4519-a67f-0809df7bbc20 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:30.151419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58daee2a-5d8d-4519-a67f-0809df7bbc20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:30.153195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-58daee2a-5d8d-4519-a67f-0809df7bbc20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:30.164918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58daee2a-5d8d-4519-a67f-0809df7bbc20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:30.166529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58daee2a-5d8d-4519-a67f-0809df7bbc20 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:30.176358 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1162/2314] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:33.795192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633c04c-93f3-497d-967c-aadc189b8b8a service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:33.871866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633c04c-93f3-497d-967c-aadc189b8b8a service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:33.876953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:33.877864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:33.878145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:33.878415 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] PATH_INFO: `/v3/users/71b3c369f81e433a9fdb05b9ac554979` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:33.879682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b3c369f81e433a9fdb05b9ac554979)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:33.881976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:33.929916 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b3c369f81e433a9fdb05b9ac554979'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:33.936966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b3c369f81e433a9fdb05b9ac554979'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:33.937658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b3c369f81e433a9fdb05b9ac554979'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:33.938241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b3c369f81e433a9fdb05b9ac554979'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:33.946945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b3c369f81e433a9fdb05b9ac554979'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:33.963884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1153/2315] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:02:33 2022] DELETE /identity/v3/users/71b3c369f81e433a9fdb05b9ac554979 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:33.968516 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942440-c3cb-408e-a8bd-5f2b814ef758 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:33.968983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942440-c3cb-408e-a8bd-5f2b814ef758 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:33.969079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942440-c3cb-408e-a8bd-5f2b814ef758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:33.986757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3c942440-c3cb-408e-a8bd-5f2b814ef758 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:33.987963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3c942440-c3cb-408e-a8bd-5f2b814ef758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:34.054454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1163/2316] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:34.065007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:34.066574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:34.124432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabb3eb-c915-43a8-8b62-f8684bbfd3b4 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:34.128757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aca521-c98a-4cd1-a50f-d997f63bd1ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:34.129356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aca521-c98a-4cd1-a50f-d997f63bd1ba service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:34.129625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aca521-c98a-4cd1-a50f-d997f63bd1ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:34.129892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aca521-c98a-4cd1-a50f-d997f63bd1ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:34.139078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aca521-c98a-4cd1-a50f-d997f63bd1ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:34.140494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aca521-c98a-4cd1-a50f-d997f63bd1ba service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:34.149828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1154/2317] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:34.427565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942440-c3cb-408e-a8bd-5f2b814ef758 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:34.429428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3c942440-c3cb-408e-a8bd-5f2b814ef758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:34.454035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942440-c3cb-408e-a8bd-5f2b814ef758 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:34.462985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:34.464346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:34.464813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:34.465366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] PATH_INFO: `/v3/projects/13d0457f711d40b9994fcf2476ca312b` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:34.466544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d0457f711d40b9994fcf2476ca312b)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:34.468475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:34.515480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d0457f711d40b9994fcf2476ca312b', 'request_id': 'req-add7af80-8028-478a-8894-de7c63c45298'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.524132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d0457f711d40b9994fcf2476ca312b', 'request_id': 'req-add7af80-8028-478a-8894-de7c63c45298'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.530400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d0457f711d40b9994fcf2476ca312b', 'request_id': 'req-add7af80-8028-478a-8894-de7c63c45298'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.540158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] The token cache is being invalidate because project 13d0457f711d40b9994fcf2476ca312b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:02:34.540439 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.541059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.542616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1164/2318] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:02:34 2022] DELETE /identity/v3/projects/13d0457f711d40b9994fcf2476ca312b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:34.546565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aca521-c98a-4cd1-a50f-d997f63bd1ba service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:34.556172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aca521-c98a-4cd1-a50f-d997f63bd1ba service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:34.609798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:34.610789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:34.611067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:34.611336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] PATH_INFO: `/v3/users/48b934c36e614932b3671720638fbede` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:34.612567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b934c36e614932b3671720638fbede)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:34.614544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:34.665944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b934c36e614932b3671720638fbede'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.677159 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b934c36e614932b3671720638fbede'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.678265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b934c36e614932b3671720638fbede'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.679317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b934c36e614932b3671720638fbede'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.688681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-501b987d-5484-4cbe-88cb-11b34c6cf4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b934c36e614932b3671720638fbede'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:34.706290 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1155/2319] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:02:34 2022] DELETE /identity/v3/users/48b934c36e614932b3671720638fbede => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:34.987697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:34.989320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:35.003435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7af80-8028-478a-8894-de7c63c45298 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.058984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.059856 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.060141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.060417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] PATH_INFO: `/v3/projects/d39283e875524aa096ec5276c1e58061` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.061655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39283e875524aa096ec5276c1e58061)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.063575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.108815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39283e875524aa096ec5276c1e58061', 'request_id': 'req-77a7f01e-4349-4bc5-a193-473c4e102178'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:35.116883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39283e875524aa096ec5276c1e58061', 'request_id': 'req-77a7f01e-4349-4bc5-a193-473c4e102178'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:35.123466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39283e875524aa096ec5276c1e58061', 'request_id': 'req-77a7f01e-4349-4bc5-a193-473c4e102178'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:35.134266 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] The token cache is being invalidate because project d39283e875524aa096ec5276c1e58061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:02:35.134548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:35.135242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-77a7f01e-4349-4bc5-a193-473c4e102178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:35.136958 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1165/2320] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:02:34 2022] DELETE /identity/v3/projects/d39283e875524aa096ec5276c1e58061 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:35.142174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e9c09-8dd8-416f-a0e4-f629004285d2 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.142683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e9c09-8dd8-416f-a0e4-f629004285d2 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.142778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e9c09-8dd8-416f-a0e4-f629004285d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.160534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-4f4e9c09-8dd8-416f-a0e4-f629004285d2 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:35.161774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4f4e9c09-8dd8-416f-a0e4-f629004285d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:35.228322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1156/2321] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:35.236435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201ca24-e4f9-4571-b037-26f8ce687d58 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.236634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201ca24-e4f9-4571-b037-26f8ce687d58 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.236935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201ca24-e4f9-4571-b037-26f8ce687d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.257426 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d201ca24-e4f9-4571-b037-26f8ce687d58 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:35.258666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d201ca24-e4f9-4571-b037-26f8ce687d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:35.267145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1166/2322] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:35.271641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e9c09-8dd8-416f-a0e4-f629004285d2 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.282072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e9c09-8dd8-416f-a0e4-f629004285d2 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.288335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affbd8b-64ed-43ce-9585-0cc31108c6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.288992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affbd8b-64ed-43ce-9585-0cc31108c6bd admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.289272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affbd8b-64ed-43ce-9585-0cc31108c6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.289548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affbd8b-64ed-43ce-9585-0cc31108c6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.290322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affbd8b-64ed-43ce-9585-0cc31108c6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:02:35.290627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affbd8b-64ed-43ce-9585-0cc31108c6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.292226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affbd8b-64ed-43ce-9585-0cc31108c6bd admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.304123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1157/2323] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:02:35.308558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201ca24-e4f9-4571-b037-26f8ce687d58 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.318126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201ca24-e4f9-4571-b037-26f8ce687d58 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.324107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16affb-1e14-4787-8540-5855c11ebbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.324759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16affb-1e14-4787-8540-5855c11ebbfe admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.325039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16affb-1e14-4787-8540-5855c11ebbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.325320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16affb-1e14-4787-8540-5855c11ebbfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.326031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16affb-1e14-4787-8540-5855c11ebbfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.327931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16affb-1e14-4787-8540-5855c11ebbfe admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.362790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1167/2324] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:02:35 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:35.363900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affbd8b-64ed-43ce-9585-0cc31108c6bd admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.374590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affbd8b-64ed-43ce-9585-0cc31108c6bd admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.435686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d54bb-7266-47de-b5ee-7faa2704f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.436374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d54bb-7266-47de-b5ee-7faa2704f6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.436661 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d54bb-7266-47de-b5ee-7faa2704f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.436937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d54bb-7266-47de-b5ee-7faa2704f6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.437669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d54bb-7266-47de-b5ee-7faa2704f6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.439587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d54bb-7266-47de-b5ee-7faa2704f6d5 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.464712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1158/2325] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:02:35 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:35.465990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16affb-1e14-4787-8540-5855c11ebbfe admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.476536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16affb-1e14-4787-8540-5855c11ebbfe admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.481267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf114d-e652-42b5-bad2-7b8a6537c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.481960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf114d-e652-42b5-bad2-7b8a6537c751 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.482240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf114d-e652-42b5-bad2-7b8a6537c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.482541 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf114d-e652-42b5-bad2-7b8a6537c751 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.483333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf114d-e652-42b5-bad2-7b8a6537c751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.485063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf114d-e652-42b5-bad2-7b8a6537c751 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.499046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1168/2326] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:35.500597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d54bb-7266-47de-b5ee-7faa2704f6d5 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.511891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d54bb-7266-47de-b5ee-7faa2704f6d5 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.516784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dfad8-9c3e-4a5b-ab97-715f437d7ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.517560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dfad8-9c3e-4a5b-ab97-715f437d7ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.517833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dfad8-9c3e-4a5b-ab97-715f437d7ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.518125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dfad8-9c3e-4a5b-ab97-715f437d7ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.518867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dfad8-9c3e-4a5b-ab97-715f437d7ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.520480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dfad8-9c3e-4a5b-ab97-715f437d7ec0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.534995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1159/2327] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:35.536021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf114d-e652-42b5-bad2-7b8a6537c751 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.547369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf114d-e652-42b5-bad2-7b8a6537c751 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.552910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14aa7a-3331-4111-baa0-eb29a1cc279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.553981 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14aa7a-3331-4111-baa0-eb29a1cc279e admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.554339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14aa7a-3331-4111-baa0-eb29a1cc279e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.554623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14aa7a-3331-4111-baa0-eb29a1cc279e admin admin] PATH_INFO: `/v3/projects/f560d5ea5a7c4d839df52175b241e5b5/users/1869298cdb27432095dadb3a36565082/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.570478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14aa7a-3331-4111-baa0-eb29a1cc279e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f560d5ea5a7c4d839df52175b241e5b5, user_id=1869298cdb27432095dadb3a36565082, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.573077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14aa7a-3331-4111-baa0-eb29a1cc279e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.588051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1169/2328] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:35 2022] PUT /identity/v3/projects/f560d5ea5a7c4d839df52175b241e5b5/users/1869298cdb27432095dadb3a36565082/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:02:35.598594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d0bd5-0afa-4be3-8bd0-4c4e581872eb None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.599104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d0bd5-0afa-4be3-8bd0-4c4e581872eb None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.599515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d0bd5-0afa-4be3-8bd0-4c4e581872eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.629436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-340d0bd5-0afa-4be3-8bd0-4c4e581872eb None None] MFA Rules not processed for user `1869298cdb27432095dadb3a36565082`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:35.631216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-340d0bd5-0afa-4be3-8bd0-4c4e581872eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:35.715852 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1160/2329] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:35.720133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14aa7a-3331-4111-baa0-eb29a1cc279e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.784234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14aa7a-3331-4111-baa0-eb29a1cc279e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.788746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc47e1-44dd-4868-817e-4f247a31e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.789433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc47e1-44dd-4868-817e-4f247a31e628 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.789831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc47e1-44dd-4868-817e-4f247a31e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.790103 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc47e1-44dd-4868-817e-4f247a31e628 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.790801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc47e1-44dd-4868-817e-4f247a31e628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.792741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc47e1-44dd-4868-817e-4f247a31e628 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.819744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1170/2330] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:02:35 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:35.824802 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d0bd5-0afa-4be3-8bd0-4c4e581872eb None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.836889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d0bd5-0afa-4be3-8bd0-4c4e581872eb None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.905638 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b206387-3805-40c8-941e-cd5500544b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.906583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b206387-3805-40c8-941e-cd5500544b5a admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.906936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b206387-3805-40c8-941e-cd5500544b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.907300 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b206387-3805-40c8-941e-cd5500544b5a admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.908314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b206387-3805-40c8-941e-cd5500544b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.911367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b206387-3805-40c8-941e-cd5500544b5a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.935250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1161/2331] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:02:35 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:35.939735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc47e1-44dd-4868-817e-4f247a31e628 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.952351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc47e1-44dd-4868-817e-4f247a31e628 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.958110 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200e23-cef0-41df-b9c1-c96b48d06dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.958822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200e23-cef0-41df-b9c1-c96b48d06dce admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.959102 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200e23-cef0-41df-b9c1-c96b48d06dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.959375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200e23-cef0-41df-b9c1-c96b48d06dce admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:35.960136 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40200e23-cef0-41df-b9c1-c96b48d06dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:35.961838 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40200e23-cef0-41df-b9c1-c96b48d06dce admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:35.972697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1171/2332] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:02:35.976776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b206387-3805-40c8-941e-cd5500544b5a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:35.987207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b206387-3805-40c8-941e-cd5500544b5a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:35.993052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde87bb3-91c4-4a83-b648-8e40c77cd900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:35.993975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde87bb3-91c4-4a83-b648-8e40c77cd900 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:35.994258 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde87bb3-91c4-4a83-b648-8e40c77cd900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:35.994531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde87bb3-91c4-4a83-b648-8e40c77cd900 admin admin] PATH_INFO: `/v3/projects/9c4afcd4cb544fb48aca08ad210556eb/users/45f38fa0f0234c3d97f639e729bdd584/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:36.010135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde87bb3-91c4-4a83-b648-8e40c77cd900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4afcd4cb544fb48aca08ad210556eb, user_id=45f38fa0f0234c3d97f639e729bdd584, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:36.012770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde87bb3-91c4-4a83-b648-8e40c77cd900 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:36.028174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1162/2333] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:35 2022] PUT /identity/v3/projects/9c4afcd4cb544fb48aca08ad210556eb/users/45f38fa0f0234c3d97f639e729bdd584/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:02:36.032320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200e23-cef0-41df-b9c1-c96b48d06dce admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:36.042492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200e23-cef0-41df-b9c1-c96b48d06dce admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:36.101814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96aa451-2100-4df0-b67b-f3e80811132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:36.102435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aa451-2100-4df0-b67b-f3e80811132d admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:36.102713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aa451-2100-4df0-b67b-f3e80811132d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:36.102988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96aa451-2100-4df0-b67b-f3e80811132d admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:36.103723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aa451-2100-4df0-b67b-f3e80811132d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:36.105339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96aa451-2100-4df0-b67b-f3e80811132d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:36.117911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1172/2334] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:36.122274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde87bb3-91c4-4a83-b648-8e40c77cd900 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:36.132831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde87bb3-91c4-4a83-b648-8e40c77cd900 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:36.137726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a8f40-6853-42e0-8639-b822aa6a407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:36.138642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a8f40-6853-42e0-8639-b822aa6a407b admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:36.138920 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a8f40-6853-42e0-8639-b822aa6a407b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:36.139191 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a8f40-6853-42e0-8639-b822aa6a407b admin admin] PATH_INFO: `/v3/projects/9c4afcd4cb544fb48aca08ad210556eb/users/45f38fa0f0234c3d97f639e729bdd584/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:36.141349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a8f40-6853-42e0-8639-b822aa6a407b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4afcd4cb544fb48aca08ad210556eb, user_id=45f38fa0f0234c3d97f639e729bdd584, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:36.144003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a8f40-6853-42e0-8639-b822aa6a407b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:36.155334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1163/2335] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:36 2022] PUT /identity/v3/projects/9c4afcd4cb544fb48aca08ad210556eb/users/45f38fa0f0234c3d97f639e729bdd584/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:36.167104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae445c-97f7-4c1b-8d8d-a7ae9165968f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:36.167387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae445c-97f7-4c1b-8d8d-a7ae9165968f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:36.167656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae445c-97f7-4c1b-8d8d-a7ae9165968f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:36.196860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-42ae445c-97f7-4c1b-8d8d-a7ae9165968f None None] MFA Rules not processed for user `45f38fa0f0234c3d97f639e729bdd584`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:36.198666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-42ae445c-97f7-4c1b-8d8d-a7ae9165968f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:36.271741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1173/2336] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:36.286116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a8f40-6853-42e0-8639-b822aa6a407b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:36.288107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-065a8f40-6853-42e0-8639-b822aa6a407b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:36.350902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a8f40-6853-42e0-8639-b822aa6a407b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:36.356919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9081b-8974-4c73-bf87-58066a5ac1fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:36.357649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9081b-8974-4c73-bf87-58066a5ac1fa service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:36.357895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9081b-8974-4c73-bf87-58066a5ac1fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:36.358192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9081b-8974-4c73-bf87-58066a5ac1fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:36.370864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9081b-8974-4c73-bf87-58066a5ac1fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:36.372244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9081b-8974-4c73-bf87-58066a5ac1fa service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:36.381860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1164/2337] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:36.520555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae445c-97f7-4c1b-8d8d-a7ae9165968f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:36.583852 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae445c-97f7-4c1b-8d8d-a7ae9165968f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:36.588819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:36.589729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:36.590010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:36.590286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] PATH_INFO: `/v3/users/1869298cdb27432095dadb3a36565082` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:36.591497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1869298cdb27432095dadb3a36565082)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:36.593453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:36.645604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1869298cdb27432095dadb3a36565082'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:36.652236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1869298cdb27432095dadb3a36565082'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:36.652891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1869298cdb27432095dadb3a36565082'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:36.653535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1869298cdb27432095dadb3a36565082'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:36.661316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1869298cdb27432095dadb3a36565082'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:36.677668 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1174/2338] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:02:36 2022] DELETE /identity/v3/users/1869298cdb27432095dadb3a36565082 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:36.682341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f51b01-c3bf-40ed-93af-35b6ec7760df None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:36.682607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f51b01-c3bf-40ed-93af-35b6ec7760df None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:36.682883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f51b01-c3bf-40ed-93af-35b6ec7760df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:36.700224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-65f51b01-c3bf-40ed-93af-35b6ec7760df None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:36.701484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-65f51b01-c3bf-40ed-93af-35b6ec7760df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:36.765379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1165/2339] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:36.781205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:36.782639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:36.837798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767510eb-477a-4547-9693-2a804dccda28 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:36.841720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c7a8-19f6-4589-8ac5-cd2ef4129780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:36.842373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c7a8-19f6-4589-8ac5-cd2ef4129780 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:36.842659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c7a8-19f6-4589-8ac5-cd2ef4129780 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:36.842935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c7a8-19f6-4589-8ac5-cd2ef4129780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:36.851919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7c7a8-19f6-4589-8ac5-cd2ef4129780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:36.853447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7c7a8-19f6-4589-8ac5-cd2ef4129780 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:36.862737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1175/2340] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:37.144137 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f51b01-c3bf-40ed-93af-35b6ec7760df None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:37.145741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-65f51b01-c3bf-40ed-93af-35b6ec7760df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:37.158037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f51b01-c3bf-40ed-93af-35b6ec7760df None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:37.163165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:37.164072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:37.164357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:37.164670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] PATH_INFO: `/v3/projects/f560d5ea5a7c4d839df52175b241e5b5` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:37.165921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f560d5ea5a7c4d839df52175b241e5b5)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:37.168067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:37.216549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f560d5ea5a7c4d839df52175b241e5b5', 'request_id': 'req-9a71e0b4-67d3-4775-8589-d46fec562a45'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.222767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f560d5ea5a7c4d839df52175b241e5b5', 'request_id': 'req-9a71e0b4-67d3-4775-8589-d46fec562a45'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.231917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f560d5ea5a7c4d839df52175b241e5b5', 'request_id': 'req-9a71e0b4-67d3-4775-8589-d46fec562a45'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.242511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] The token cache is being invalidate because project f560d5ea5a7c4d839df52175b241e5b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:02:37.242850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.243533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.245148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1166/2341] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:02:37 2022] DELETE /identity/v3/projects/f560d5ea5a7c4d839df52175b241e5b5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:37.249449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c7a8-19f6-4589-8ac5-cd2ef4129780 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:37.259217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c7a8-19f6-4589-8ac5-cd2ef4129780 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:37.315598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:37.316476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:37.316755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:37.317027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] PATH_INFO: `/v3/users/45f38fa0f0234c3d97f639e729bdd584` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:37.318384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f38fa0f0234c3d97f639e729bdd584)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:37.320350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:37.371964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f38fa0f0234c3d97f639e729bdd584'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.379424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f38fa0f0234c3d97f639e729bdd584'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.380129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f38fa0f0234c3d97f639e729bdd584'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.380794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f38fa0f0234c3d97f639e729bdd584'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.390765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-23c21efe-6e73-4ea3-b2f8-38d11fef6cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f38fa0f0234c3d97f639e729bdd584'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.407493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1176/2342] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:02:37 2022] DELETE /identity/v3/users/45f38fa0f0234c3d97f639e729bdd584 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:37.672000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:37.673692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:37.687274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71e0b4-67d3-4775-8589-d46fec562a45 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:37.746622 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:37.747486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:37.747766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:37.748033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] PATH_INFO: `/v3/projects/9c4afcd4cb544fb48aca08ad210556eb` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:37.749228 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4afcd4cb544fb48aca08ad210556eb)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:37.751497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:37.802801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4afcd4cb544fb48aca08ad210556eb', 'request_id': 'req-7828c731-7e59-4c37-8444-50c8d5f003f6'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.809077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4afcd4cb544fb48aca08ad210556eb', 'request_id': 'req-7828c731-7e59-4c37-8444-50c8d5f003f6'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.817663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4afcd4cb544fb48aca08ad210556eb', 'request_id': 'req-7828c731-7e59-4c37-8444-50c8d5f003f6'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.830296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] The token cache is being invalidate because project 9c4afcd4cb544fb48aca08ad210556eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:02:37.830585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.831224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7828c731-7e59-4c37-8444-50c8d5f003f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:37.832805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1167/2343] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:02:37 2022] DELETE /identity/v3/projects/9c4afcd4cb544fb48aca08ad210556eb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:37.838630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459351a-f0fe-482c-9e91-c5b636fc86d8 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:37.839129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459351a-f0fe-482c-9e91-c5b636fc86d8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:37.839588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459351a-f0fe-482c-9e91-c5b636fc86d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:37.858042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c459351a-f0fe-482c-9e91-c5b636fc86d8 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:37.859262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c459351a-f0fe-482c-9e91-c5b636fc86d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:37.918196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1177/2344] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:37.926392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384c64c-eea0-4a2a-b1bb-0d51b26ac736 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:37.926681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384c64c-eea0-4a2a-b1bb-0d51b26ac736 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:37.926959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384c64c-eea0-4a2a-b1bb-0d51b26ac736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:37.945746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-b384c64c-eea0-4a2a-b1bb-0d51b26ac736 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:37.947098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b384c64c-eea0-4a2a-b1bb-0d51b26ac736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:37.958472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1168/2345] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:37.963193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459351a-f0fe-482c-9e91-c5b636fc86d8 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:37.972851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459351a-f0fe-482c-9e91-c5b636fc86d8 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:37.978347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d329a-a66d-470d-ba11-13f34005b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:37.979017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d329a-a66d-470d-ba11-13f34005b1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:37.979296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d329a-a66d-470d-ba11-13f34005b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:37.979563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d329a-a66d-470d-ba11-13f34005b1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:37.980302 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d329a-a66d-470d-ba11-13f34005b1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:02:37.980606 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d329a-a66d-470d-ba11-13f34005b1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:37.982263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d329a-a66d-470d-ba11-13f34005b1c2 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:37.994576 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1178/2346] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:02:37.999070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384c64c-eea0-4a2a-b1bb-0d51b26ac736 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:38.008585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384c64c-eea0-4a2a-b1bb-0d51b26ac736 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:38.014235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df452df6-edb9-49e8-8bc6-de857350b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:38.014905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df452df6-edb9-49e8-8bc6-de857350b1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:38.015164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df452df6-edb9-49e8-8bc6-de857350b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:38.015457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df452df6-edb9-49e8-8bc6-de857350b1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:38.016155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df452df6-edb9-49e8-8bc6-de857350b1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:38.018094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df452df6-edb9-49e8-8bc6-de857350b1b9 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:38.045828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1169/2347] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:02:37 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:02:38.050063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d329a-a66d-470d-ba11-13f34005b1c2 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:38.060293 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d329a-a66d-470d-ba11-13f34005b1c2 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:38.134799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b153-59af-4ce7-9474-fe9017f98934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:38.135469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b153-59af-4ce7-9474-fe9017f98934 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:38.135780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b153-59af-4ce7-9474-fe9017f98934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:38.136051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b153-59af-4ce7-9474-fe9017f98934 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:38.136760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8b153-59af-4ce7-9474-fe9017f98934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:38.138731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8b153-59af-4ce7-9474-fe9017f98934 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:38.159664 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1179/2348] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:02:38 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:38.163998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df452df6-edb9-49e8-8bc6-de857350b1b9 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:38.174763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df452df6-edb9-49e8-8bc6-de857350b1b9 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:38.179444 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7929-8e68-41fd-a7ab-aa735f2c6f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:38.180118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7929-8e68-41fd-a7ab-aa735f2c6f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:38.180433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7929-8e68-41fd-a7ab-aa735f2c6f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:38.180700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7929-8e68-41fd-a7ab-aa735f2c6f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:38.181469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db7929-8e68-41fd-a7ab-aa735f2c6f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:38.183197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db7929-8e68-41fd-a7ab-aa735f2c6f38 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:38.193625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1170/2349] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:38.197808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b153-59af-4ce7-9474-fe9017f98934 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:38.208032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b153-59af-4ce7-9474-fe9017f98934 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:38.212985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17783d6-b59a-4b72-b23d-34c0cabb0f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:38.213683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17783d6-b59a-4b72-b23d-34c0cabb0f7e admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:38.213964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17783d6-b59a-4b72-b23d-34c0cabb0f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:38.214244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17783d6-b59a-4b72-b23d-34c0cabb0f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:38.215014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17783d6-b59a-4b72-b23d-34c0cabb0f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:38.216613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17783d6-b59a-4b72-b23d-34c0cabb0f7e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:38.226488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1180/2350] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:38.230650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7929-8e68-41fd-a7ab-aa735f2c6f38 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:38.241917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7929-8e68-41fd-a7ab-aa735f2c6f38 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:38.247826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd545b32-8454-491c-a3e3-c537f76f63bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:38.248706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd545b32-8454-491c-a3e3-c537f76f63bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:38.248983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd545b32-8454-491c-a3e3-c537f76f63bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:38.249255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd545b32-8454-491c-a3e3-c537f76f63bc admin admin] PATH_INFO: `/v3/projects/0ef3f227e85c4dea85dacc8bc570cc17/users/880711897a714db381e3a86fb377130b/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:38.265247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd545b32-8454-491c-a3e3-c537f76f63bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef3f227e85c4dea85dacc8bc570cc17, user_id=880711897a714db381e3a86fb377130b, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:38.267952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd545b32-8454-491c-a3e3-c537f76f63bc admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:38.282645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1171/2351] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:38 2022] PUT /identity/v3/projects/0ef3f227e85c4dea85dacc8bc570cc17/users/880711897a714db381e3a86fb377130b/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:38.295270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34446e8e-7611-4ef3-b09d-c12c10e70504 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:38.295818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34446e8e-7611-4ef3-b09d-c12c10e70504 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:38.295818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34446e8e-7611-4ef3-b09d-c12c10e70504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:38.326053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-34446e8e-7611-4ef3-b09d-c12c10e70504 None None] MFA Rules not processed for user `880711897a714db381e3a86fb377130b`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:38.327255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-34446e8e-7611-4ef3-b09d-c12c10e70504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:38.400402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1181/2352] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:38.411930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd545b32-8454-491c-a3e3-c537f76f63bc admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:38.414003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-dd545b32-8454-491c-a3e3-c537f76f63bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:38.475881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd545b32-8454-491c-a3e3-c537f76f63bc admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:38.479969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d28ae-5aad-4e5c-a2dd-06ff776aa971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:38.480623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d28ae-5aad-4e5c-a2dd-06ff776aa971 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:38.480905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d28ae-5aad-4e5c-a2dd-06ff776aa971 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:38.481176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d28ae-5aad-4e5c-a2dd-06ff776aa971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:38.489670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d28ae-5aad-4e5c-a2dd-06ff776aa971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:38.491452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d28ae-5aad-4e5c-a2dd-06ff776aa971 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:38.500229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1172/2353] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:43.044942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34446e8e-7611-4ef3-b09d-c12c10e70504 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:43.046523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-34446e8e-7611-4ef3-b09d-c12c10e70504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:43.119514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34446e8e-7611-4ef3-b09d-c12c10e70504 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:43.125268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931bb64-939e-4a63-a9cc-224c7270427a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:43.125943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931bb64-939e-4a63-a9cc-224c7270427a service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:43.126215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931bb64-939e-4a63-a9cc-224c7270427a service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:43.126486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931bb64-939e-4a63-a9cc-224c7270427a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:43.128274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9931bb64-939e-4a63-a9cc-224c7270427a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:43.186698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931bb64-939e-4a63-a9cc-224c7270427a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:43.188390 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931bb64-939e-4a63-a9cc-224c7270427a service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:43.198503 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1182/2354] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:48.701562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4e67-9520-4773-943c-05f31507da7e None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:48.701562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4e67-9520-4773-943c-05f31507da7e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:48.701562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4e67-9520-4773-943c-05f31507da7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:48.703608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931bb64-939e-4a63-a9cc-224c7270427a service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:48.718408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-5dea4e67-9520-4773-943c-05f31507da7e None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:48.719627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5dea4e67-9520-4773-943c-05f31507da7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:48.770471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931bb64-939e-4a63-a9cc-224c7270427a service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:48.774940 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:48.775817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:48.776093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:48.776365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] PATH_INFO: `/v3/users/880711897a714db381e3a86fb377130b` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:48.777561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880711897a714db381e3a86fb377130b)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:48.779537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:48.780925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1173/2355] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 19:02:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:48.826761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880711897a714db381e3a86fb377130b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:48.828948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea4e67-9520-4773-943c-05f31507da7e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:48.830432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5dea4e67-9520-4773-943c-05f31507da7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:48.833710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880711897a714db381e3a86fb377130b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:48.834375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880711897a714db381e3a86fb377130b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:48.835060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880711897a714db381e3a86fb377130b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:48.842985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-abdaa909-3b49-4e46-b256-38625a8feea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880711897a714db381e3a86fb377130b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:48.859232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1183/2356] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:02:48 2022] DELETE /identity/v3/users/880711897a714db381e3a86fb377130b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:02:48.863615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a0ea1-a58a-49dc-86c6-7d60f727bd1f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:48.863906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a0ea1-a58a-49dc-86c6-7d60f727bd1f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:48.864183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a0ea1-a58a-49dc-86c6-7d60f727bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:48.881068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-443a0ea1-a58a-49dc-86c6-7d60f727bd1f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:48.882479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-443a0ea1-a58a-49dc-86c6-7d60f727bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:48.902664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea4e67-9520-4773-943c-05f31507da7e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:48.949037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1184/2357] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:02:48.958685 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a0ea1-a58a-49dc-86c6-7d60f727bd1f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:48.960130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-443a0ea1-a58a-49dc-86c6-7d60f727bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:48.966007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:48.966676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:48.966958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:48.967236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:48.969069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:49.014757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a0ea1-a58a-49dc-86c6-7d60f727bd1f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:49.018507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6fcbb-285c-4a5b-a735-d9900cfe9f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:49.019157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6fcbb-285c-4a5b-a735-d9900cfe9f58 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.019436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6fcbb-285c-4a5b-a735-d9900cfe9f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.019708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6fcbb-285c-4a5b-a735-d9900cfe9f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.023726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:49.025409 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:49.029014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6fcbb-285c-4a5b-a735-d9900cfe9f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:49.030473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6fcbb-285c-4a5b-a735-d9900cfe9f58 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:49.033873 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1174/2358] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:02:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 19:02:49.040081 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1185/2359] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:02:49.355440 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:49.357314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:49.379552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf554d87-fe50-4430-9cd5-5d4d263ad9cd service swift] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:49.385594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:49.386510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.386789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.387062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] PATH_INFO: `/v3/projects/0ef3f227e85c4dea85dacc8bc570cc17` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.388377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef3f227e85c4dea85dacc8bc570cc17)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:49.390407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:49.444530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef3f227e85c4dea85dacc8bc570cc17', 'request_id': 'req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:49.451273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef3f227e85c4dea85dacc8bc570cc17', 'request_id': 'req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:49.461891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef3f227e85c4dea85dacc8bc570cc17', 'request_id': 'req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:49.472773 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] The token cache is being invalidate because project 0ef3f227e85c4dea85dacc8bc570cc17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:02:49.473058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:49.473775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e90b45c0-24d1-4021-9a6d-ec039edbf1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:02:49.475345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1175/2360] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:02:49 2022] DELETE /identity/v3/projects/0ef3f227e85c4dea85dacc8bc570cc17 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:49.480673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c3aae-c09e-42fd-ada4-de94e0bf5c59 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.480963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c3aae-c09e-42fd-ada4-de94e0bf5c59 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.481305 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c3aae-c09e-42fd-ada4-de94e0bf5c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.500514 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3b0c3aae-c09e-42fd-ada4-de94e0bf5c59 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:49.501794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3b0c3aae-c09e-42fd-ada4-de94e0bf5c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:49.566534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1186/2361] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:49.574281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a78a0-a277-4d16-9105-3f889beac125 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.574922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a78a0-a277-4d16-9105-3f889beac125 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.575265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a78a0-a277-4d16-9105-3f889beac125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.596226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-676a78a0-a277-4d16-9105-3f889beac125 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:49.597562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-676a78a0-a277-4d16-9105-3f889beac125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:49.610176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1176/2362] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:02:49.612731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c3aae-c09e-42fd-ada4-de94e0bf5c59 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:49.625164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c3aae-c09e-42fd-ada4-de94e0bf5c59 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:49.630993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b5760-313a-4f4f-b89b-5ff3b47e055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:49.631673 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5760-313a-4f4f-b89b-5ff3b47e055a admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.631957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5760-313a-4f4f-b89b-5ff3b47e055a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.632510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5760-313a-4f4f-b89b-5ff3b47e055a admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.633142 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b5760-313a-4f4f-b89b-5ff3b47e055a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:02:49.633484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b5760-313a-4f4f-b89b-5ff3b47e055a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:49.635102 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b5760-313a-4f4f-b89b-5ff3b47e055a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:49.655361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1187/2363] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:02:49.664174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a78a0-a277-4d16-9105-3f889beac125 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:49.681353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a78a0-a277-4d16-9105-3f889beac125 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:49.686348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c968a-12b2-41bb-8b9e-df46f69b273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:49.687024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c968a-12b2-41bb-8b9e-df46f69b273c admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.687305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c968a-12b2-41bb-8b9e-df46f69b273c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.687611 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c968a-12b2-41bb-8b9e-df46f69b273c admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.688462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c968a-12b2-41bb-8b9e-df46f69b273c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:49.690458 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c968a-12b2-41bb-8b9e-df46f69b273c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:49.721547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1177/2364] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:02:49 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:49.724430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b5760-313a-4f4f-b89b-5ff3b47e055a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:49.734000 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b5760-313a-4f4f-b89b-5ff3b47e055a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:49.792676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509aca-85ed-4acb-b0dd-3f8fe2d4df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:49.793598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509aca-85ed-4acb-b0dd-3f8fe2d4df3b admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.793988 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509aca-85ed-4acb-b0dd-3f8fe2d4df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.794332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509aca-85ed-4acb-b0dd-3f8fe2d4df3b admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.795110 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c509aca-85ed-4acb-b0dd-3f8fe2d4df3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:49.797446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c509aca-85ed-4acb-b0dd-3f8fe2d4df3b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:49.825844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1188/2365] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:02:49 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:02:49.826795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c968a-12b2-41bb-8b9e-df46f69b273c admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:49.848266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c968a-12b2-41bb-8b9e-df46f69b273c admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:49.853424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca5c3-d49d-4de2-bc00-6f7e57a2651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:49.854421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca5c3-d49d-4de2-bc00-6f7e57a2651f admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.854906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca5c3-d49d-4de2-bc00-6f7e57a2651f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.855382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca5c3-d49d-4de2-bc00-6f7e57a2651f admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.856745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ca5c3-d49d-4de2-bc00-6f7e57a2651f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:49.858781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ca5c3-d49d-4de2-bc00-6f7e57a2651f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:49.877873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509aca-85ed-4acb-b0dd-3f8fe2d4df3b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:49.884120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1178/2366] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:02:49.892593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509aca-85ed-4acb-b0dd-3f8fe2d4df3b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:49.898341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631916d-3640-43cd-99ee-b15125f814af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:49.899404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631916d-3640-43cd-99ee-b15125f814af admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.899893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631916d-3640-43cd-99ee-b15125f814af admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.900489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631916d-3640-43cd-99ee-b15125f814af admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.901477 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631916d-3640-43cd-99ee-b15125f814af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:49.903371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631916d-3640-43cd-99ee-b15125f814af admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:49.926061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1189/2367] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:02:49.927719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca5c3-d49d-4de2-bc00-6f7e57a2651f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:49.942589 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca5c3-d49d-4de2-bc00-6f7e57a2651f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:49.955151 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b251f-a833-4ebf-b4b7-490604240cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:49.956188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b251f-a833-4ebf-b4b7-490604240cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:49.956376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b251f-a833-4ebf-b4b7-490604240cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:49.956590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b251f-a833-4ebf-b4b7-490604240cf4 admin admin] PATH_INFO: `/v3/projects/1de3018f59464b10acbc27fcea3956d2/users/d1f83559272d4650a12e94f40d5db982/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:49.976511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b251f-a833-4ebf-b4b7-490604240cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de3018f59464b10acbc27fcea3956d2, user_id=d1f83559272d4650a12e94f40d5db982, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:49.979187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b251f-a833-4ebf-b4b7-490604240cf4 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:50.003275 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1179/2368] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:02:49 2022] PUT /identity/v3/projects/1de3018f59464b10acbc27fcea3956d2/users/d1f83559272d4650a12e94f40d5db982/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:02:50.007252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13075e31-2383-48f6-bf08-194c160690c2 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:50.007537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13075e31-2383-48f6-bf08-194c160690c2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:50.007815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13075e31-2383-48f6-bf08-194c160690c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:50.048559 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-13075e31-2383-48f6-bf08-194c160690c2 None None] MFA Rules not processed for user `d1f83559272d4650a12e94f40d5db982`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:50.050208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-13075e31-2383-48f6-bf08-194c160690c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:50.147063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1190/2369] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:50.160460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b251f-a833-4ebf-b4b7-490604240cf4 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:50.162431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-496b251f-a833-4ebf-b4b7-490604240cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:50.238344 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b251f-a833-4ebf-b4b7-490604240cf4 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:50.244077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fbcab-8540-4943-8b8e-b1b68bdb2f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:50.244673 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fbcab-8540-4943-8b8e-b1b68bdb2f9c service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:50.244949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fbcab-8540-4943-8b8e-b1b68bdb2f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:50.245227 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fbcab-8540-4943-8b8e-b1b68bdb2f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:50.255595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fbcab-8540-4943-8b8e-b1b68bdb2f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:50.257754 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fbcab-8540-4943-8b8e-b1b68bdb2f9c service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:50.269155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1180/2370] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:02:51.701181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961577ce-60fe-46bd-bbda-5e9b577ee557 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:51.701793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961577ce-60fe-46bd-bbda-5e9b577ee557 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:51.701793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961577ce-60fe-46bd-bbda-5e9b577ee557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:51.719373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-961577ce-60fe-46bd-bbda-5e9b577ee557 None None] MFA Rules not processed for user `d1f83559272d4650a12e94f40d5db982`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:02:51.720583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-961577ce-60fe-46bd-bbda-5e9b577ee557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:51.727404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1191/2371] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:02:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:02:58.268848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fbcab-8540-4943-8b8e-b1b68bdb2f9c service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:02:58.271579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b96fbcab-8540-4943-8b8e-b1b68bdb2f9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:58.486356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fbcab-8540-4943-8b8e-b1b68bdb2f9c service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:02:58.499398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:02:58.500524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:02:58.502932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:02:58.503864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:02:58.506626 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:02:58.529678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:02:58.532080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:02:58.546701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1181/2372] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:02:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:00.279135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961577ce-60fe-46bd-bbda-5e9b577ee557 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:00.281607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-961577ce-60fe-46bd-bbda-5e9b577ee557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:00.326326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961577ce-60fe-46bd-bbda-5e9b577ee557 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:00.345846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b3561-73e5-4bce-a6c0-acd9df305b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:00.349361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b3561-73e5-4bce-a6c0-acd9df305b80 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:00.350019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b3561-73e5-4bce-a6c0-acd9df305b80 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:00.350526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b3561-73e5-4bce-a6c0-acd9df305b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:00.354971 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-2a6b3561-73e5-4bce-a6c0-acd9df305b80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:00.402779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b3561-73e5-4bce-a6c0-acd9df305b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:00.405279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b3561-73e5-4bce-a6c0-acd9df305b80 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:00.477476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1192/2373] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:04.749492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:04.751515 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:04.814593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79b233-5362-4601-9ad2-efc7334f08f0 service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:04.818143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b87226-9604-484a-a980-cc54dd3ee767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:04.818808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b87226-9604-484a-a980-cc54dd3ee767 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:04.819090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b87226-9604-484a-a980-cc54dd3ee767 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:04.819364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b87226-9604-484a-a980-cc54dd3ee767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:04.821145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f0b87226-9604-484a-a980-cc54dd3ee767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:04.884726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b87226-9604-484a-a980-cc54dd3ee767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:04.886473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b87226-9604-484a-a980-cc54dd3ee767 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:04.898994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1182/2374] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:05.234698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90961a7-ca6a-4356-83ec-aa432220e58a None None] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:05.235294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90961a7-ca6a-4356-83ec-aa432220e58a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:05.235294 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90961a7-ca6a-4356-83ec-aa432220e58a None None] PATH_INFO: `/` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:05.236741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1193/2375] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 4 19:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 19:03:05.244077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021e105-93b2-47e4-81b4-6958239c21b9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:05.244705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021e105-93b2-47e4-81b4-6958239c21b9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:05.245088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021e105-93b2-47e4-81b4-6958239c21b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:05.267791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-a021e105-93b2-47e4-81b4-6958239c21b9 None None] MFA Rules not processed for user `3938216005694c45bd6126415930d014`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:05.269032 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a021e105-93b2-47e4-81b4-6958239c21b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:05.278618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1183/2376] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 4 19:03:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:05.291296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90961a7-ca6a-4356-83ec-aa432220e58a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:05.293262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-f90961a7-ca6a-4356-83ec-aa432220e58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:05.359080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90961a7-ca6a-4356-83ec-aa432220e58a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:05.365990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ec1b-fbac-4836-bdf1-a654e5b9b4c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63b338ae7e374ba5a7542c5a53deb416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:05.366699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ec1b-fbac-4836-bdf1-a654e5b9b4c8 service glance] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:05.367171 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ec1b-fbac-4836-bdf1-a654e5b9b4c8 service glance] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:05.367449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ec1b-fbac-4836-bdf1-a654e5b9b4c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:05.379351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1ec1b-fbac-4836-bdf1-a654e5b9b4c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:05.381400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1ec1b-fbac-4836-bdf1-a654e5b9b4c8 service glance] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:05.400265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1194/2377] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:05.640443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021e105-93b2-47e4-81b4-6958239c21b9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:05.641913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a021e105-93b2-47e4-81b4-6958239c21b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:05.653378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021e105-93b2-47e4-81b4-6958239c21b9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:05.657093 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:05.657777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:05.658064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:05.658333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:05.660084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:05.672684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:05.674168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:05.684079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1184/2378] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:06.406376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ec1b-fbac-4836-bdf1-a654e5b9b4c8 service glance] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:06.422796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ec1b-fbac-4836-bdf1-a654e5b9b4c8 service glance] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:06.437303 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:06.438751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:06.439216 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:06.447007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:06.449993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:06.539885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:06.541463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:06.555120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1195/2379] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:09.768451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:09.770618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:09.787503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160e654-cfd0-4b02-ab0a-5f2eceaba9ae service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:09.793070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:09.794396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:09.794997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:09.795424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] PATH_INFO: `/v3/users/c983699bd73f41fc813c41c498261ece` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:09.798025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c983699bd73f41fc813c41c498261ece)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:09.801112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:09.878996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c983699bd73f41fc813c41c498261ece'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:09.892664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c983699bd73f41fc813c41c498261ece'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:09.894605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c983699bd73f41fc813c41c498261ece'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:09.895431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c983699bd73f41fc813c41c498261ece'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:09.913695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-4b926092-b901-4880-8e91-cc4a1286771b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c983699bd73f41fc813c41c498261ece'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:09.933613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1185/2380] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:09 2022] DELETE /identity/v3/users/c983699bd73f41fc813c41c498261ece => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:09.982626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:09.987622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:10.004098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7b91d-364b-40d8-89d6-86961f8b71a0 service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:10.078837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:10.079734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.080015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.080290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] PATH_INFO: `/v3/users/b35f3684e2e648148e1273ad6f7b7cb2` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.081649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35f3684e2e648148e1273ad6f7b7cb2)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:10.083742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:10.106003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bed67-a409-4b1f-ad8e-c52a50b0d955 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.106003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bed67-a409-4b1f-ad8e-c52a50b0d955 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.106003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bed67-a409-4b1f-ad8e-c52a50b0d955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.123962 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-496bed67-a409-4b1f-ad8e-c52a50b0d955 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:10.125262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-496bed67-a409-4b1f-ad8e-c52a50b0d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:10.151315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35f3684e2e648148e1273ad6f7b7cb2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.166493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35f3684e2e648148e1273ad6f7b7cb2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.167324 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35f3684e2e648148e1273ad6f7b7cb2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.169317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35f3684e2e648148e1273ad6f7b7cb2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.183170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35f3684e2e648148e1273ad6f7b7cb2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.199391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1186/2381] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 19:03:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:10.213144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bed67-a409-4b1f-ad8e-c52a50b0d955 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:10.215098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-496bed67-a409-4b1f-ad8e-c52a50b0d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:10.224594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1196/2382] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:09 2022] DELETE /identity/v3/users/b35f3684e2e648148e1273ad6f7b7cb2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:10.280254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:10.281774 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:10.313582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bed67-a409-4b1f-ad8e-c52a50b0d955 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:10.384560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b268d-042e-4322-ad2e-e5f84ba36277 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:10.385243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b268d-042e-4322-ad2e-e5f84ba36277 service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.385554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b268d-042e-4322-ad2e-e5f84ba36277 service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.386380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b268d-042e-4322-ad2e-e5f84ba36277 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.392506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc3d18-b81c-4bda-b8c6-8f07a223afae admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:10.399393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:10.401125 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.401625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.402092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] PATH_INFO: `/v3/projects/dd17f7a747ad43fc905b8d1688a71ba7` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.403540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd17f7a747ad43fc905b8d1688a71ba7)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:10.406379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:10.455321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b268d-042e-4322-ad2e-e5f84ba36277 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:10.457154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b268d-042e-4322-ad2e-e5f84ba36277 service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:10.472091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1187/2383] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:03:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:03:10.480614 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b268d-042e-4322-ad2e-e5f84ba36277 service swift] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:10.482151 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd17f7a747ad43fc905b8d1688a71ba7', 'request_id': 'req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.482490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c33b268d-042e-4322-ad2e-e5f84ba36277 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:10.498421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd17f7a747ad43fc905b8d1688a71ba7', 'request_id': 'req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.507129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd17f7a747ad43fc905b8d1688a71ba7', 'request_id': 'req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.514501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b268d-042e-4322-ad2e-e5f84ba36277 service swift] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:10.526033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] The token cache is being invalidate because project dd17f7a747ad43fc905b8d1688a71ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:10.526329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.527013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-c0b38201-cff4-47be-8cf4-bb3a04fccbe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.529487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1197/2384] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:10 2022] DELETE /identity/v3/projects/dd17f7a747ad43fc905b8d1688a71ba7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:10.534523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfd0f2-f739-4b07-93b3-2f5ce5149cc6 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.534814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfd0f2-f739-4b07-93b3-2f5ce5149cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.535096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfd0f2-f739-4b07-93b3-2f5ce5149cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.557725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-73dfd0f2-f739-4b07-93b3-2f5ce5149cc6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:10.559525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-73dfd0f2-f739-4b07-93b3-2f5ce5149cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:10.593266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:10.594616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.595080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.595548 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] PATH_INFO: `/v3/projects/d220357192eb4ba5a2cdd43f000cd4c4` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.596978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d220357192eb4ba5a2cdd43f000cd4c4)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:10.599166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:10.649447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1198/2385] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:10.658051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1134b-3fad-4702-a5ce-4a4e4e1bd7c4 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.661021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1134b-3fad-4702-a5ce-4a4e4e1bd7c4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.661567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1134b-3fad-4702-a5ce-4a4e4e1bd7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.679192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd220357192eb4ba5a2cdd43f000cd4c4', 'request_id': 'req-edf48e77-1191-40d6-aff8-35a474a58220'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.687934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd220357192eb4ba5a2cdd43f000cd4c4', 'request_id': 'req-edf48e77-1191-40d6-aff8-35a474a58220'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.702288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd220357192eb4ba5a2cdd43f000cd4c4', 'request_id': 'req-edf48e77-1191-40d6-aff8-35a474a58220'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.708173 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b3a1134b-3fad-4702-a5ce-4a4e4e1bd7c4 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:10.709646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b3a1134b-3fad-4702-a5ce-4a4e4e1bd7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:10.754799 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] The token cache is being invalidate because project d220357192eb4ba5a2cdd43f000cd4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:10.755111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.755908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-edf48e77-1191-40d6-aff8-35a474a58220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:10.757806 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1188/2386] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:10 2022] DELETE /identity/v3/projects/d220357192eb4ba5a2cdd43f000cd4c4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:10.762874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095b85d-b8b0-4d3c-8a0f-d7b234095675 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.763484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095b85d-b8b0-4d3c-8a0f-d7b234095675 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.763948 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095b85d-b8b0-4d3c-8a0f-d7b234095675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.803190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7095b85d-b8b0-4d3c-8a0f-d7b234095675 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:10.805795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7095b85d-b8b0-4d3c-8a0f-d7b234095675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:10.903061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1199/2387] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:10.904001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1134b-3fad-4702-a5ce-4a4e4e1bd7c4 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:10.905599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1189/2388] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:10.917719 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1134b-3fad-4702-a5ce-4a4e4e1bd7c4 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:10.925612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c1b2a-5da1-4867-8a50-2f615a9ae202 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.926481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c1b2a-5da1-4867-8a50-2f615a9ae202 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.926962 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c1b2a-5da1-4867-8a50-2f615a9ae202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.941699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e9457-023f-48cd-b5a8-ff4d39c2d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:10.942613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e9457-023f-48cd-b5a8-ff4d39c2d6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:10.943061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e9457-023f-48cd-b5a8-ff4d39c2d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:10.943479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e9457-023f-48cd-b5a8-ff4d39c2d6e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:10.944381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e9457-023f-48cd-b5a8-ff4d39c2d6e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:10.946314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e9457-023f-48cd-b5a8-ff4d39c2d6e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:10.954725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e9457-023f-48cd-b5a8-ff4d39c2d6e5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:10.972310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ba3c1b2a-5da1-4867-8a50-2f615a9ae202 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:10.977681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ba3c1b2a-5da1-4867-8a50-2f615a9ae202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:10.989547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1190/2389] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:10.993834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c1b2a-5da1-4867-8a50-2f615a9ae202 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:10.999728 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1200/2390] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:11.010459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c1b2a-5da1-4867-8a50-2f615a9ae202 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.013552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e9457-023f-48cd-b5a8-ff4d39c2d6e5 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.034711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2999ce-b8c2-4912-8fd0-f83efe8f5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.037165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2999ce-b8c2-4912-8fd0-f83efe8f5a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.038552 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2999ce-b8c2-4912-8fd0-f83efe8f5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.039606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2999ce-b8c2-4912-8fd0-f83efe8f5a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.040387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2999ce-b8c2-4912-8fd0-f83efe8f5a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:11.045383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2999ce-b8c2-4912-8fd0-f83efe8f5a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.050817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e9457-023f-48cd-b5a8-ff4d39c2d6e5 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.051575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2999ce-b8c2-4912-8fd0-f83efe8f5a58 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.064262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466cfdd-b815-4d91-b259-3b286f9082ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.065152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466cfdd-b815-4d91-b259-3b286f9082ed admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.065662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466cfdd-b815-4d91-b259-3b286f9082ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.066108 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466cfdd-b815-4d91-b259-3b286f9082ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.066968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466cfdd-b815-4d91-b259-3b286f9082ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.069068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466cfdd-b815-4d91-b259-3b286f9082ed admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.102695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1191/2391] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:03:11.104985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2999ce-b8c2-4912-8fd0-f83efe8f5a58 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.135484 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2999ce-b8c2-4912-8fd0-f83efe8f5a58 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.141336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1201/2392] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/projects => generated 409 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:11.144657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecdff5-5a56-4769-94d9-6b03a18e07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.145741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecdff5-5a56-4769-94d9-6b03a18e07aa admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.146045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466cfdd-b815-4d91-b259-3b286f9082ed admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.146202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecdff5-5a56-4769-94d9-6b03a18e07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.146574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecdff5-5a56-4769-94d9-6b03a18e07aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.147413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecdff5-5a56-4769-94d9-6b03a18e07aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.160347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecdff5-5a56-4769-94d9-6b03a18e07aa admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.240238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1192/2393] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:11.243620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecdff5-5a56-4769-94d9-6b03a18e07aa admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.248528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466cfdd-b815-4d91-b259-3b286f9082ed admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.324263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1e3b6-fbaa-404b-bcb0-f35a054ee1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.325431 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e3b6-fbaa-404b-bcb0-f35a054ee1df admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.325931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e3b6-fbaa-404b-bcb0-f35a054ee1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.326408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e3b6-fbaa-404b-bcb0-f35a054ee1df admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.327944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1e3b6-fbaa-404b-bcb0-f35a054ee1df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.330011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1e3b6-fbaa-404b-bcb0-f35a054ee1df admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.353047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecdff5-5a56-4769-94d9-6b03a18e07aa admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.358175 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3683-01ef-4e28-91b4-7337da1d25da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.359160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3683-01ef-4e28-91b4-7337da1d25da admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.359546 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3683-01ef-4e28-91b4-7337da1d25da admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.359935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3683-01ef-4e28-91b4-7337da1d25da admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.360731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff3683-01ef-4e28-91b4-7337da1d25da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.362970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff3683-01ef-4e28-91b4-7337da1d25da admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.369038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1202/2394] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/users => generated 305 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:11.372793 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1e3b6-fbaa-404b-bcb0-f35a054ee1df admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.393354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1193/2395] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/users => generated 302 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:11.395182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3683-01ef-4e28-91b4-7337da1d25da admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.395349 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1e3b6-fbaa-404b-bcb0-f35a054ee1df admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.411087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3683-01ef-4e28-91b4-7337da1d25da admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.412380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61e87d-7c10-4e35-978b-c8898a3e7888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.413175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61e87d-7c10-4e35-978b-c8898a3e7888 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.413486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61e87d-7c10-4e35-978b-c8898a3e7888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.413765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61e87d-7c10-4e35-978b-c8898a3e7888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.414517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61e87d-7c10-4e35-978b-c8898a3e7888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.416506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61e87d-7c10-4e35-978b-c8898a3e7888 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.418040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157092c6-4812-4b68-a557-1d0795c8defb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.418949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157092c6-4812-4b68-a557-1d0795c8defb admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.419406 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157092c6-4812-4b68-a557-1d0795c8defb admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.419861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157092c6-4812-4b68-a557-1d0795c8defb admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.420820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157092c6-4812-4b68-a557-1d0795c8defb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.423095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157092c6-4812-4b68-a557-1d0795c8defb admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.437161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1194/2396] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:11.437381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1203/2397] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:11.441047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61e87d-7c10-4e35-978b-c8898a3e7888 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.442439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157092c6-4812-4b68-a557-1d0795c8defb admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.454031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61e87d-7c10-4e35-978b-c8898a3e7888 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.454595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157092c6-4812-4b68-a557-1d0795c8defb admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.468536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0760bf-b3d7-49f1-9507-a9d32229428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.469530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0760bf-b3d7-49f1-9507-a9d32229428a admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.470101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0760bf-b3d7-49f1-9507-a9d32229428a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.470494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0760bf-b3d7-49f1-9507-a9d32229428a admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.471126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47c20f-d031-4015-9d39-828dd4835921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.471657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0760bf-b3d7-49f1-9507-a9d32229428a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.471810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47c20f-d031-4015-9d39-828dd4835921 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.472099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47c20f-d031-4015-9d39-828dd4835921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.472367 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47c20f-d031-4015-9d39-828dd4835921 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.473121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47c20f-d031-4015-9d39-828dd4835921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.473821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0760bf-b3d7-49f1-9507-a9d32229428a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.475484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47c20f-d031-4015-9d39-828dd4835921 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.488169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1204/2398] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:11.491983 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1195/2399] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:11.495628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47c20f-d031-4015-9d39-828dd4835921 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.505067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0760bf-b3d7-49f1-9507-a9d32229428a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.514058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47c20f-d031-4015-9d39-828dd4835921 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.524650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404af160-a8e4-42c8-b330-41cf3a1f1454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.525690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404af160-a8e4-42c8-b330-41cf3a1f1454 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.526650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404af160-a8e4-42c8-b330-41cf3a1f1454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.527437 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404af160-a8e4-42c8-b330-41cf3a1f1454 admin admin] PATH_INFO: `/v3/projects/3387c7080b8f4414b6eadf0857b64888/users/8e3eaa0ac0204cef88b311ff8458d601/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.528208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0760bf-b3d7-49f1-9507-a9d32229428a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.539479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1884d-e7a0-4c82-87f3-02ff335a73c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.541307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1884d-e7a0-4c82-87f3-02ff335a73c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.542027 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1884d-e7a0-4c82-87f3-02ff335a73c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.543230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1884d-e7a0-4c82-87f3-02ff335a73c4 admin admin] PATH_INFO: `/v3/projects/72b34b44e5264a48bd10d6e3d209708d/users/704aac6130134b73bbf186e7656f9860/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.564496 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404af160-a8e4-42c8-b330-41cf3a1f1454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3387c7080b8f4414b6eadf0857b64888, user_id=8e3eaa0ac0204cef88b311ff8458d601, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.567742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1884d-e7a0-4c82-87f3-02ff335a73c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b34b44e5264a48bd10d6e3d209708d, user_id=704aac6130134b73bbf186e7656f9860, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.568235 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404af160-a8e4-42c8-b330-41cf3a1f1454 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.571330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1884d-e7a0-4c82-87f3-02ff335a73c4 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.593992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1205/2400] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:11 2022] PUT /identity/v3/projects/3387c7080b8f4414b6eadf0857b64888/users/8e3eaa0ac0204cef88b311ff8458d601/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:11.594241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1196/2401] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:11 2022] PUT /identity/v3/projects/72b34b44e5264a48bd10d6e3d209708d/users/704aac6130134b73bbf186e7656f9860/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:11.596296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712fc8-aa05-419d-818b-637f4a159247 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.597680 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712fc8-aa05-419d-818b-637f4a159247 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.598153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712fc8-aa05-419d-818b-637f4a159247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.603099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e2a49-80b6-47a3-99b1-29d1eedc2d80 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.603438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e2a49-80b6-47a3-99b1-29d1eedc2d80 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.605667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e2a49-80b6-47a3-99b1-29d1eedc2d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.634383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9f7e2a49-80b6-47a3-99b1-29d1eedc2d80 None None] MFA Rules not processed for user `704aac6130134b73bbf186e7656f9860`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:11.635788 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9f7e2a49-80b6-47a3-99b1-29d1eedc2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:11.640484 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6d712fc8-aa05-419d-818b-637f4a159247 None None] MFA Rules not processed for user `8e3eaa0ac0204cef88b311ff8458d601`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:11.641977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6d712fc8-aa05-419d-818b-637f4a159247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:11.724911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1206/2402] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:11.725592 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1197/2403] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:11.726443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712fc8-aa05-419d-818b-637f4a159247 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.729077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e2a49-80b6-47a3-99b1-29d1eedc2d80 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.802515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712fc8-aa05-419d-818b-637f4a159247 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.805167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e2a49-80b6-47a3-99b1-29d1eedc2d80 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.807734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dca64-3548-45d8-b6fa-2944b74bd19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.808557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dca64-3548-45d8-b6fa-2944b74bd19f admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.808878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dca64-3548-45d8-b6fa-2944b74bd19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.809228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dca64-3548-45d8-b6fa-2944b74bd19f admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.810144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dca64-3548-45d8-b6fa-2944b74bd19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.812150 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dca64-3548-45d8-b6fa-2944b74bd19f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.815911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338b204-ff8c-46b4-8b7d-7c06c9d21287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.820155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338b204-ff8c-46b4-8b7d-7c06c9d21287 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.820155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338b204-ff8c-46b4-8b7d-7c06c9d21287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.820155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338b204-ff8c-46b4-8b7d-7c06c9d21287 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.820155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338b204-ff8c-46b4-8b7d-7c06c9d21287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.825171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338b204-ff8c-46b4-8b7d-7c06c9d21287 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:11.860442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1198/2404] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/projects => generated 409 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:11.864055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1207/2405] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:11.864867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338b204-ff8c-46b4-8b7d-7c06c9d21287 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.869830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dca64-3548-45d8-b6fa-2944b74bd19f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:11.952349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338b204-ff8c-46b4-8b7d-7c06c9d21287 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.966825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dca64-3548-45d8-b6fa-2944b74bd19f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:11.972225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabd80a-d4a2-4059-82f7-a6d9d4b69899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:11.973019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd80a-d4a2-4059-82f7-a6d9d4b69899 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:11.973450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd80a-d4a2-4059-82f7-a6d9d4b69899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:11.973720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd80a-d4a2-4059-82f7-a6d9d4b69899 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:11.974408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabd80a-d4a2-4059-82f7-a6d9d4b69899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:11.976810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabd80a-d4a2-4059-82f7-a6d9d4b69899 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.004290 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1208/2406] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/users => generated 308 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:12.008267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabd80a-d4a2-4059-82f7-a6d9d4b69899 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.035193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabd80a-d4a2-4059-82f7-a6d9d4b69899 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.041545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881d68-b560-4943-955e-3766c1b6c621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.042240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881d68-b560-4943-955e-3766c1b6c621 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.042522 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881d68-b560-4943-955e-3766c1b6c621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.042798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881d68-b560-4943-955e-3766c1b6c621 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.043880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08881d68-b560-4943-955e-3766c1b6c621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.046873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08881d68-b560-4943-955e-3766c1b6c621 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.061126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0eaee-d9b1-486f-95eb-af01d128c27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.061413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1209/2407] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:12.061854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0eaee-d9b1-486f-95eb-af01d128c27f admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.062142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0eaee-d9b1-486f-95eb-af01d128c27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.062612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0eaee-d9b1-486f-95eb-af01d128c27f admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.063322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0eaee-d9b1-486f-95eb-af01d128c27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.065526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0eaee-d9b1-486f-95eb-af01d128c27f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.066935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881d68-b560-4943-955e-3766c1b6c621 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.085166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881d68-b560-4943-955e-3766c1b6c621 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.091174 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50b95f-31f2-4f7c-aec4-cfa8ed578a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.092433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50b95f-31f2-4f7c-aec4-cfa8ed578a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.092840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50b95f-31f2-4f7c-aec4-cfa8ed578a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.093211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50b95f-31f2-4f7c-aec4-cfa8ed578a5f admin admin] PATH_INFO: `/v3/projects/99ef6c8f86824f0da3478b7088358575/users/a60d34398d9843aa82fb127c7ad69356/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.097334 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1199/2408] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:11 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:12.101490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0eaee-d9b1-486f-95eb-af01d128c27f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.111984 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0eaee-d9b1-486f-95eb-af01d128c27f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.117049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153db09-08c6-44d0-8e5a-f2b0873c90af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.117767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153db09-08c6-44d0-8e5a-f2b0873c90af admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.118041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153db09-08c6-44d0-8e5a-f2b0873c90af admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.118151 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50b95f-31f2-4f7c-aec4-cfa8ed578a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ef6c8f86824f0da3478b7088358575, user_id=a60d34398d9843aa82fb127c7ad69356, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.118312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153db09-08c6-44d0-8e5a-f2b0873c90af admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.119050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153db09-08c6-44d0-8e5a-f2b0873c90af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.120815 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153db09-08c6-44d0-8e5a-f2b0873c90af admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.121156 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50b95f-31f2-4f7c-aec4-cfa8ed578a5f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.132867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1200/2409] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:12.137492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153db09-08c6-44d0-8e5a-f2b0873c90af admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.155906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153db09-08c6-44d0-8e5a-f2b0873c90af admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.158226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1210/2410] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:12 2022] PUT /identity/v3/projects/99ef6c8f86824f0da3478b7088358575/users/a60d34398d9843aa82fb127c7ad69356/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:12.162056 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50b95f-31f2-4f7c-aec4-cfa8ed578a5f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.227905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8820234-d1ed-4c7a-b257-e98b16973118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.228790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8820234-d1ed-4c7a-b257-e98b16973118 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.229107 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8820234-d1ed-4c7a-b257-e98b16973118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.229539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8820234-d1ed-4c7a-b257-e98b16973118 admin admin] PATH_INFO: `/v3/projects/c4eb334181fa4ae29fbf8e535731fd5e/users/8734cfab719545f789a1de4adf6dd53b/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.239788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50b95f-31f2-4f7c-aec4-cfa8ed578a5f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.245175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bff736-91d6-4f28-baff-1886138ec029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.246358 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8820234-d1ed-4c7a-b257-e98b16973118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4eb334181fa4ae29fbf8e535731fd5e, user_id=8734cfab719545f789a1de4adf6dd53b, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.246522 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bff736-91d6-4f28-baff-1886138ec029 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.246780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bff736-91d6-4f28-baff-1886138ec029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.247105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bff736-91d6-4f28-baff-1886138ec029 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.247843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bff736-91d6-4f28-baff-1886138ec029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.249113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8820234-d1ed-4c7a-b257-e98b16973118 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.249525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bff736-91d6-4f28-baff-1886138ec029 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.264738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1211/2411] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:03:12.266588 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bff736-91d6-4f28-baff-1886138ec029 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.272078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1201/2412] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:12 2022] PUT /identity/v3/projects/c4eb334181fa4ae29fbf8e535731fd5e/users/8734cfab719545f789a1de4adf6dd53b/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:12.273265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8820234-d1ed-4c7a-b257-e98b16973118 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.279182 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bff736-91d6-4f28-baff-1886138ec029 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.347747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4680b-45aa-452d-80ba-4eca84a1dc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.348724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4680b-45aa-452d-80ba-4eca84a1dc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.349102 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4680b-45aa-452d-80ba-4eca84a1dc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.349508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4680b-45aa-452d-80ba-4eca84a1dc4f admin admin] PATH_INFO: `/v3/projects/99ef6c8f86824f0da3478b7088358575/users/a60d34398d9843aa82fb127c7ad69356/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.357085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8820234-d1ed-4c7a-b257-e98b16973118 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.362878 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0b7ee-345c-4d5b-88a6-4ff690522fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.363567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0b7ee-345c-4d5b-88a6-4ff690522fab admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.363688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4680b-45aa-452d-80ba-4eca84a1dc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ef6c8f86824f0da3478b7088358575, user_id=a60d34398d9843aa82fb127c7ad69356, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.363889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0b7ee-345c-4d5b-88a6-4ff690522fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.364272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0b7ee-345c-4d5b-88a6-4ff690522fab admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.365063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0b7ee-345c-4d5b-88a6-4ff690522fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.368449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0b7ee-345c-4d5b-88a6-4ff690522fab admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.371032 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4680b-45aa-452d-80ba-4eca84a1dc4f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.401459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1202/2413] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:12.402698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0b7ee-345c-4d5b-88a6-4ff690522fab admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.406734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1212/2414] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:12 2022] PUT /identity/v3/projects/99ef6c8f86824f0da3478b7088358575/users/a60d34398d9843aa82fb127c7ad69356/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:12.425786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824bc8-2413-44bb-be99-7d4bd10a3b9e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.426078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824bc8-2413-44bb-be99-7d4bd10a3b9e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.426356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824bc8-2413-44bb-be99-7d4bd10a3b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.431062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0b7ee-345c-4d5b-88a6-4ff690522fab admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.497714 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a8824bc8-2413-44bb-be99-7d4bd10a3b9e None None] MFA Rules not processed for user `a60d34398d9843aa82fb127c7ad69356`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:12.499111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a8824bc8-2413-44bb-be99-7d4bd10a3b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:12.556014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b4578-7f2c-4ab9-a63e-9b3a5a349123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.556965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b4578-7f2c-4ab9-a63e-9b3a5a349123 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.557262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b4578-7f2c-4ab9-a63e-9b3a5a349123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.557570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b4578-7f2c-4ab9-a63e-9b3a5a349123 admin admin] PATH_INFO: `/v3/projects/c4eb334181fa4ae29fbf8e535731fd5e/users/8734cfab719545f789a1de4adf6dd53b/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.560132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b4578-7f2c-4ab9-a63e-9b3a5a349123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4eb334181fa4ae29fbf8e535731fd5e, user_id=8734cfab719545f789a1de4adf6dd53b, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.563306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b4578-7f2c-4ab9-a63e-9b3a5a349123 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.589488 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1203/2415] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:12 2022] PUT /identity/v3/projects/c4eb334181fa4ae29fbf8e535731fd5e/users/8734cfab719545f789a1de4adf6dd53b/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:12.592754 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49527-3c45-4c77-91d8-7da836aea287 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.593046 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49527-3c45-4c77-91d8-7da836aea287 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.594028 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed49527-3c45-4c77-91d8-7da836aea287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.628454 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1213/2416] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:12.648167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824bc8-2413-44bb-be99-7d4bd10a3b9e None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.650346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a8824bc8-2413-44bb-be99-7d4bd10a3b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:12.650784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-bed49527-3c45-4c77-91d8-7da836aea287 None None] MFA Rules not processed for user `8734cfab719545f789a1de4adf6dd53b`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:12.652003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-bed49527-3c45-4c77-91d8-7da836aea287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:12.723713 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824bc8-2413-44bb-be99-7d4bd10a3b9e None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.746374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1204/2417] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:12.757926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49527-3c45-4c77-91d8-7da836aea287 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:12.759312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-bed49527-3c45-4c77-91d8-7da836aea287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:12.797987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b673a5-89d0-4724-b6d1-bb77e9b6569c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.798657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b673a5-89d0-4724-b6d1-bb77e9b6569c service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.798934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b673a5-89d0-4724-b6d1-bb77e9b6569c service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.799208 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b673a5-89d0-4724-b6d1-bb77e9b6569c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.830439 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed49527-3c45-4c77-91d8-7da836aea287 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:12.834273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0a18c-f17d-49af-b7a5-e02394231bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:12.834935 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0a18c-f17d-49af-b7a5-e02394231bde service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:12.835213 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0a18c-f17d-49af-b7a5-e02394231bde service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:12.835481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0a18c-f17d-49af-b7a5-e02394231bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:12.846800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0a18c-f17d-49af-b7a5-e02394231bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.848653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0a18c-f17d-49af-b7a5-e02394231bde service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.859427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1205/2418] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:12 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:12.877521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b673a5-89d0-4724-b6d1-bb77e9b6569c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:12.880176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b673a5-89d0-4724-b6d1-bb77e9b6569c service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:12.892683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1214/2419] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:13.057677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0a18c-f17d-49af-b7a5-e02394231bde service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:13.059378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b673a5-89d0-4724-b6d1-bb77e9b6569c service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:13.069243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b673a5-89d0-4724-b6d1-bb77e9b6569c service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:13.078013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8ca99-dd02-451a-8c93-4f3199929e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:13.079143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8ca99-dd02-451a-8c93-4f3199929e74 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:13.079427 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8ca99-dd02-451a-8c93-4f3199929e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:13.079730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8ca99-dd02-451a-8c93-4f3199929e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:13.142097 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8ca99-dd02-451a-8c93-4f3199929e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:13.143831 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8ca99-dd02-451a-8c93-4f3199929e74 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:13.155064 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1215/2420] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:13.161472 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0a18c-f17d-49af-b7a5-e02394231bde service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:13.167151 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:13.168565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:13.168984 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:13.169342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] PATH_INFO: `/v3/users/704aac6130134b73bbf186e7656f9860` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:13.175902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=704aac6130134b73bbf186e7656f9860)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:13.175902 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:13.240113 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '704aac6130134b73bbf186e7656f9860'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:13.248139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '704aac6130134b73bbf186e7656f9860'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:13.248958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '704aac6130134b73bbf186e7656f9860'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:13.249645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '704aac6130134b73bbf186e7656f9860'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:13.261477 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '704aac6130134b73bbf186e7656f9860'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:13.286500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1206/2421] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:13 2022] DELETE /identity/v3/users/704aac6130134b73bbf186e7656f9860 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:13.288561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8d90-45a9-4de0-97c8-a02cf6b3fc74 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:13.289026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8d90-45a9-4de0-97c8-a02cf6b3fc74 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:13.289399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8d90-45a9-4de0-97c8-a02cf6b3fc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:13.309538 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-410c8d90-45a9-4de0-97c8-a02cf6b3fc74 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:13.311094 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-410c8d90-45a9-4de0-97c8-a02cf6b3fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:13.392806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1216/2422] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:13.403496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:13.404996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:13.515774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020f423-ba94-4d6a-8d1b-15f3e0e54b51 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:13.520497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245d8c5-88d6-4f43-b401-095aad87f066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:13.521045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245d8c5-88d6-4f43-b401-095aad87f066 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:13.521166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245d8c5-88d6-4f43-b401-095aad87f066 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:13.521973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245d8c5-88d6-4f43-b401-095aad87f066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:13.532676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245d8c5-88d6-4f43-b401-095aad87f066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:13.534273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245d8c5-88d6-4f43-b401-095aad87f066 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:13.545906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1207/2423] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:13.981411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c8d90-45a9-4de0-97c8-a02cf6b3fc74 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:13.983055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-410c8d90-45a9-4de0-97c8-a02cf6b3fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:14.004873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c8d90-45a9-4de0-97c8-a02cf6b3fc74 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:14.018577 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:14.019563 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:14.019846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:14.020128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] PATH_INFO: `/v3/projects/72b34b44e5264a48bd10d6e3d209708d` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:14.021406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b34b44e5264a48bd10d6e3d209708d)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:14.023361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:14.080304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b34b44e5264a48bd10d6e3d209708d', 'request_id': 'req-557e8870-ed45-4d17-a699-4f86ebdb391c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.091571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b34b44e5264a48bd10d6e3d209708d', 'request_id': 'req-557e8870-ed45-4d17-a699-4f86ebdb391c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.099271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b34b44e5264a48bd10d6e3d209708d', 'request_id': 'req-557e8870-ed45-4d17-a699-4f86ebdb391c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.110031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] The token cache is being invalidate because project 72b34b44e5264a48bd10d6e3d209708d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:14.110317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.111036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.113001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1217/2424] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:13 2022] DELETE /identity/v3/projects/72b34b44e5264a48bd10d6e3d209708d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:14.117383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245d8c5-88d6-4f43-b401-095aad87f066 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:14.134126 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245d8c5-88d6-4f43-b401-095aad87f066 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:14.202932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:14.204065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:14.204507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:14.205043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] PATH_INFO: `/v3/users/a60d34398d9843aa82fb127c7ad69356` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:14.206543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60d34398d9843aa82fb127c7ad69356)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:14.208620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:14.260097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60d34398d9843aa82fb127c7ad69356'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.267620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60d34398d9843aa82fb127c7ad69356'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.268348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60d34398d9843aa82fb127c7ad69356'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.268938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60d34398d9843aa82fb127c7ad69356'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.276769 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e1d273aa-e234-40d6-be5d-310c1e80f799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60d34398d9843aa82fb127c7ad69356'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.295859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1208/2425] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:14 2022] DELETE /identity/v3/users/a60d34398d9843aa82fb127c7ad69356 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:14.591929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:14.593534 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:14.608938 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e8870-ed45-4d17-a699-4f86ebdb391c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:14.686976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:14.688307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:14.688654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:14.689001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] PATH_INFO: `/v3/projects/99ef6c8f86824f0da3478b7088358575` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:14.690466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ef6c8f86824f0da3478b7088358575)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:14.692924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:14.765572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ef6c8f86824f0da3478b7088358575', 'request_id': 'req-0400d453-7ca0-4368-ab72-9ecf407a07af'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.775280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ef6c8f86824f0da3478b7088358575', 'request_id': 'req-0400d453-7ca0-4368-ab72-9ecf407a07af'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.801155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ef6c8f86824f0da3478b7088358575', 'request_id': 'req-0400d453-7ca0-4368-ab72-9ecf407a07af'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.814442 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] The token cache is being invalidate because project 99ef6c8f86824f0da3478b7088358575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:14.814787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.815613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-0400d453-7ca0-4368-ab72-9ecf407a07af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:14.819076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1218/2426] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:14 2022] DELETE /identity/v3/projects/99ef6c8f86824f0da3478b7088358575 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:14.825990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f557de-c981-4687-b12f-3e2e7ba2b6a4 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:14.826586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f557de-c981-4687-b12f-3e2e7ba2b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:14.827039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f557de-c981-4687-b12f-3e2e7ba2b6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:14.853512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-40f557de-c981-4687-b12f-3e2e7ba2b6a4 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:14.855592 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-40f557de-c981-4687-b12f-3e2e7ba2b6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:14.982565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1209/2427] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:14.990399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb612d-dd6a-4468-8ffc-79c854a59803 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:14.991213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb612d-dd6a-4468-8ffc-79c854a59803 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:14.991691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb612d-dd6a-4468-8ffc-79c854a59803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.040676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-30cb612d-dd6a-4468-8ffc-79c854a59803 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:15.042062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-30cb612d-dd6a-4468-8ffc-79c854a59803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:15.064708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f557de-c981-4687-b12f-3e2e7ba2b6a4 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.069191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1219/2428] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:15.076666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f557de-c981-4687-b12f-3e2e7ba2b6a4 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.089189 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec8cab-23e3-4e88-9316-f32d27f930e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.090719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec8cab-23e3-4e88-9316-f32d27f930e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.091044 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec8cab-23e3-4e88-9316-f32d27f930e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.091366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec8cab-23e3-4e88-9316-f32d27f930e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.092285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec8cab-23e3-4e88-9316-f32d27f930e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:15.092597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec8cab-23e3-4e88-9316-f32d27f930e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.094846 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec8cab-23e3-4e88-9316-f32d27f930e8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.109723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1210/2429] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:03:15.114142 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb612d-dd6a-4468-8ffc-79c854a59803 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.137661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb612d-dd6a-4468-8ffc-79c854a59803 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.143370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5fb86-b781-4ebd-9170-ad6bb1ba06c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.144354 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5fb86-b781-4ebd-9170-ad6bb1ba06c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.144728 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5fb86-b781-4ebd-9170-ad6bb1ba06c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.145130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5fb86-b781-4ebd-9170-ad6bb1ba06c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.145969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5fb86-b781-4ebd-9170-ad6bb1ba06c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.148258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5fb86-b781-4ebd-9170-ad6bb1ba06c2 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.178825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1220/2430] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:15 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:15.180007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec8cab-23e3-4e88-9316-f32d27f930e8 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.190747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec8cab-23e3-4e88-9316-f32d27f930e8 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.249120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ae48e-976c-47ee-87e9-b036618de8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.249993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ae48e-976c-47ee-87e9-b036618de8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.250429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ae48e-976c-47ee-87e9-b036618de8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.250853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ae48e-976c-47ee-87e9-b036618de8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.251674 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ae48e-976c-47ee-87e9-b036618de8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.254306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ae48e-976c-47ee-87e9-b036618de8a7 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.277043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1211/2431] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:15 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:15.281527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5fb86-b781-4ebd-9170-ad6bb1ba06c2 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.292416 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5fb86-b781-4ebd-9170-ad6bb1ba06c2 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.297172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00cffb-54a1-44cd-be62-21bb83ed7e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.297891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00cffb-54a1-44cd-be62-21bb83ed7e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.298227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00cffb-54a1-44cd-be62-21bb83ed7e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.298508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00cffb-54a1-44cd-be62-21bb83ed7e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.299260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00cffb-54a1-44cd-be62-21bb83ed7e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.301042 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00cffb-54a1-44cd-be62-21bb83ed7e67 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.317331 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1221/2432] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:15.318297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ae48e-976c-47ee-87e9-b036618de8a7 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.328782 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ae48e-976c-47ee-87e9-b036618de8a7 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.333827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd21c4c-9b14-4a05-ab86-484ec355c526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.334502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21c4c-9b14-4a05-ab86-484ec355c526 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.334810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21c4c-9b14-4a05-ab86-484ec355c526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.335083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21c4c-9b14-4a05-ab86-484ec355c526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.336123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd21c4c-9b14-4a05-ab86-484ec355c526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.337991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd21c4c-9b14-4a05-ab86-484ec355c526 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.348895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1212/2433] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:15.353312 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00cffb-54a1-44cd-be62-21bb83ed7e67 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.363877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00cffb-54a1-44cd-be62-21bb83ed7e67 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.369574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10210dc-dc9d-485b-80d3-27b45a04c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.370580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10210dc-dc9d-485b-80d3-27b45a04c97b admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.370906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10210dc-dc9d-485b-80d3-27b45a04c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.371227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10210dc-dc9d-485b-80d3-27b45a04c97b admin admin] PATH_INFO: `/v3/projects/c9502a2adbf248f8a933f8c0e97334de/users/39e22def26b1453c9205e5a636e853fb/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.386260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10210dc-dc9d-485b-80d3-27b45a04c97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9502a2adbf248f8a933f8c0e97334de, user_id=39e22def26b1453c9205e5a636e853fb, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.389054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10210dc-dc9d-485b-80d3-27b45a04c97b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.408729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1222/2434] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:15 2022] PUT /identity/v3/projects/c9502a2adbf248f8a933f8c0e97334de/users/39e22def26b1453c9205e5a636e853fb/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:15.423751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d2ce4-c057-41e9-8bb3-ec39519ef199 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.424069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d2ce4-c057-41e9-8bb3-ec39519ef199 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.424308 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d2ce4-c057-41e9-8bb3-ec39519ef199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.453825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-1a3d2ce4-c057-41e9-8bb3-ec39519ef199 None None] MFA Rules not processed for user `39e22def26b1453c9205e5a636e853fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:15.455247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1a3d2ce4-c057-41e9-8bb3-ec39519ef199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:15.520763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1213/2435] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:15.525263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10210dc-dc9d-485b-80d3-27b45a04c97b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.587857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10210dc-dc9d-485b-80d3-27b45a04c97b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.595720 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438f2ff-3504-443b-afef-b19996dcebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.596443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438f2ff-3504-443b-afef-b19996dcebeb admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.596686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438f2ff-3504-443b-afef-b19996dcebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.596953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438f2ff-3504-443b-afef-b19996dcebeb admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.597690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438f2ff-3504-443b-afef-b19996dcebeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.599616 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438f2ff-3504-443b-afef-b19996dcebeb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.640601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1223/2436] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:15 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:15.642090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d2ce4-c057-41e9-8bb3-ec39519ef199 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.657753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d2ce4-c057-41e9-8bb3-ec39519ef199 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.719976 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cd478-320d-43f2-aba4-de34df85609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.720664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd478-320d-43f2-aba4-de34df85609b admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.720970 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd478-320d-43f2-aba4-de34df85609b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.721241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd478-320d-43f2-aba4-de34df85609b admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.721967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cd478-320d-43f2-aba4-de34df85609b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.723921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cd478-320d-43f2-aba4-de34df85609b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.747708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1214/2437] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:15 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:15.749210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438f2ff-3504-443b-afef-b19996dcebeb admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.759910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438f2ff-3504-443b-afef-b19996dcebeb admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.764911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fba631-3a0c-4ed1-8bed-a54899b2b2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.765710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fba631-3a0c-4ed1-8bed-a54899b2b2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.766057 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fba631-3a0c-4ed1-8bed-a54899b2b2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.766400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fba631-3a0c-4ed1-8bed-a54899b2b2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.767222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fba631-3a0c-4ed1-8bed-a54899b2b2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.768882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fba631-3a0c-4ed1-8bed-a54899b2b2a5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.780313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1224/2438] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:03:15.784876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cd478-320d-43f2-aba4-de34df85609b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.795745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cd478-320d-43f2-aba4-de34df85609b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.800901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b0632-46bc-4b0e-be72-5795c0fcf6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.801847 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b0632-46bc-4b0e-be72-5795c0fcf6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.802128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b0632-46bc-4b0e-be72-5795c0fcf6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.802414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b0632-46bc-4b0e-be72-5795c0fcf6a3 admin admin] PATH_INFO: `/v3/projects/edab66b6934a4a27ae191043bdd05c41/users/ffb6ed9e3b6948e4a64d5b81c33ec711/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.819194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b0632-46bc-4b0e-be72-5795c0fcf6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edab66b6934a4a27ae191043bdd05c41, user_id=ffb6ed9e3b6948e4a64d5b81c33ec711, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.822025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b0632-46bc-4b0e-be72-5795c0fcf6a3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.836188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1215/2439] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:15 2022] PUT /identity/v3/projects/edab66b6934a4a27ae191043bdd05c41/users/ffb6ed9e3b6948e4a64d5b81c33ec711/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:15.840609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fba631-3a0c-4ed1-8bed-a54899b2b2a5 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.851128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fba631-3a0c-4ed1-8bed-a54899b2b2a5 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.909219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316937a7-e7e6-4560-92cf-1ac3e640d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.909929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316937a7-e7e6-4560-92cf-1ac3e640d661 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.910210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316937a7-e7e6-4560-92cf-1ac3e640d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.910482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316937a7-e7e6-4560-92cf-1ac3e640d661 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.911351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316937a7-e7e6-4560-92cf-1ac3e640d661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.913091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316937a7-e7e6-4560-92cf-1ac3e640d661 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.926689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1225/2440] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:15.928083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b0632-46bc-4b0e-be72-5795c0fcf6a3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:15.938753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b0632-46bc-4b0e-be72-5795c0fcf6a3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:15.943361 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01009e4-8fca-4f31-8168-21c2fe1d238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:15.944261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01009e4-8fca-4f31-8168-21c2fe1d238d admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.944538 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01009e4-8fca-4f31-8168-21c2fe1d238d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.944808 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01009e4-8fca-4f31-8168-21c2fe1d238d admin admin] PATH_INFO: `/v3/projects/edab66b6934a4a27ae191043bdd05c41/users/ffb6ed9e3b6948e4a64d5b81c33ec711/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:15.946794 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01009e4-8fca-4f31-8168-21c2fe1d238d admin admin] RBAC: Authorizing `identity:create_grant(project_id=edab66b6934a4a27ae191043bdd05c41, user_id=ffb6ed9e3b6948e4a64d5b81c33ec711, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:15.949859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01009e4-8fca-4f31-8168-21c2fe1d238d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:15.971067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1216/2441] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:15 2022] PUT /identity/v3/projects/edab66b6934a4a27ae191043bdd05c41/users/ffb6ed9e3b6948e4a64d5b81c33ec711/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:15.981470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daf027-62c1-45b3-99f4-21fa7e831ae7 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:15.982341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daf027-62c1-45b3-99f4-21fa7e831ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:15.982696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daf027-62c1-45b3-99f4-21fa7e831ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:16.011813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c1daf027-62c1-45b3-99f4-21fa7e831ae7 None None] MFA Rules not processed for user `ffb6ed9e3b6948e4a64d5b81c33ec711`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:16.013011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c1daf027-62c1-45b3-99f4-21fa7e831ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:16.142662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1226/2442] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:16.148771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01009e4-8fca-4f31-8168-21c2fe1d238d admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:16.150909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d01009e4-8fca-4f31-8168-21c2fe1d238d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:16.219842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01009e4-8fca-4f31-8168-21c2fe1d238d admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:16.224657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f992d-0d8d-4f7e-9a27-a4e955a482a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:16.225460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f992d-0d8d-4f7e-9a27-a4e955a482a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:16.225964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f992d-0d8d-4f7e-9a27-a4e955a482a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:16.226290 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f992d-0d8d-4f7e-9a27-a4e955a482a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:16.247727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f992d-0d8d-4f7e-9a27-a4e955a482a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:16.249645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f992d-0d8d-4f7e-9a27-a4e955a482a2 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:16.261797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1217/2443] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:16.699654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daf027-62c1-45b3-99f4-21fa7e831ae7 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:16.709858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daf027-62c1-45b3-99f4-21fa7e831ae7 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:16.715778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06caf2-a0f2-4316-b13f-d967bea525c0 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb6ed9e3b6948e4a64d5b81c33ec711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edab66b6934a4a27ae191043bdd05c41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:16.716826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06caf2-a0f2-4316-b13f-d967bea525c0 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:16.717189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06caf2-a0f2-4316-b13f-d967bea525c0 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:16.717490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06caf2-a0f2-4316-b13f-d967bea525c0 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:16.718392 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06caf2-a0f2-4316-b13f-d967bea525c0 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:16.718705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06caf2-a0f2-4316-b13f-d967bea525c0 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:16.720511 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06caf2-a0f2-4316-b13f-d967bea525c0 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:16.737322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1227/2444] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:16.739909 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f992d-0d8d-4f7e-9a27-a4e955a482a2 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:16.750994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f992d-0d8d-4f7e-9a27-a4e955a482a2 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:16.757386 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86970-54b6-4478-8ca0-80704acdb9fe tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb6ed9e3b6948e4a64d5b81c33ec711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edab66b6934a4a27ae191043bdd05c41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:16.758210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86970-54b6-4478-8ca0-80704acdb9fe tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:16.758669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86970-54b6-4478-8ca0-80704acdb9fe tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:16.759131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86970-54b6-4478-8ca0-80704acdb9fe tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:16.760339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b86970-54b6-4478-8ca0-80704acdb9fe tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:16.764642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b86970-54b6-4478-8ca0-80704acdb9fe tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:16.800240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1218/2445] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:16 2022] POST /identity/v3/projects => generated 353 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:16.804743 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06caf2-a0f2-4316-b13f-d967bea525c0 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:16.815426 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06caf2-a0f2-4316-b13f-d967bea525c0 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:16.878759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb6ed9e3b6948e4a64d5b81c33ec711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edab66b6934a4a27ae191043bdd05c41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:16.879410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:16.879692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:16.879966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:16.880708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:16.881017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:16.882701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:16.897413 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1228/2446] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:16.941487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86970-54b6-4478-8ca0-80704acdb9fe tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:16.952132 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86970-54b6-4478-8ca0-80704acdb9fe tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:16.956708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffb6ed9e3b6948e4a64d5b81c33ec711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edab66b6934a4a27ae191043bdd05c41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:16.957662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:16.957939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:16.958207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] PATH_INFO: `/v3/projects/29c195a62c8142fc8c776795a81c1aa8` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:16.959388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Authorizing `identity:delete_project(project_id=29c195a62c8142fc8c776795a81c1aa8)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:16.961388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:17.012644 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c195a62c8142fc8c776795a81c1aa8', 'request_id': 'req-d06bfe64-1735-4a46-862e-c03b469489d3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.019596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c195a62c8142fc8c776795a81c1aa8', 'request_id': 'req-d06bfe64-1735-4a46-862e-c03b469489d3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.029181 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c195a62c8142fc8c776795a81c1aa8', 'request_id': 'req-d06bfe64-1735-4a46-862e-c03b469489d3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.041234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] The token cache is being invalidate because project 29c195a62c8142fc8c776795a81c1aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:17.041649 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.042232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d06bfe64-1735-4a46-862e-c03b469489d3 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.044145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1219/2447] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:16 2022] DELETE /identity/v3/projects/29c195a62c8142fc8c776795a81c1aa8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:17.256083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:17.257857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:17.324510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493b0eb-1a7c-4ea4-b30d-5d3817e17629 tempest-VolumeQuotaClassesTest-1128678449 tempest-VolumeQuotaClassesTest-1128678449-project-admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:17.384003 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:17.384928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:17.385205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:17.385523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] PATH_INFO: `/v3/users/39e22def26b1453c9205e5a636e853fb` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:17.386945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e22def26b1453c9205e5a636e853fb)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:17.389093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:17.466307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e22def26b1453c9205e5a636e853fb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.483977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e22def26b1453c9205e5a636e853fb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.485788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e22def26b1453c9205e5a636e853fb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.486565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e22def26b1453c9205e5a636e853fb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.496352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e22def26b1453c9205e5a636e853fb'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:17.529298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1229/2448] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:17 2022] DELETE /identity/v3/users/39e22def26b1453c9205e5a636e853fb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:17.532736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331fded-73bb-41fd-af3f-90777f3909d1 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:17.533223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331fded-73bb-41fd-af3f-90777f3909d1 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:17.533380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331fded-73bb-41fd-af3f-90777f3909d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:17.561684 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8331fded-73bb-41fd-af3f-90777f3909d1 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:17.562913 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8331fded-73bb-41fd-af3f-90777f3909d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:17.624814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1220/2449] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:17.634723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:17.636135 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:17.692970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb930-bcaf-4133-baf8-e3e0511257ab admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:17.696445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11b15-e656-426e-9c7c-6fb359e07b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:17.697115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11b15-e656-426e-9c7c-6fb359e07b37 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:17.697586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11b15-e656-426e-9c7c-6fb359e07b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:17.697854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11b15-e656-426e-9c7c-6fb359e07b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:17.707756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e11b15-e656-426e-9c7c-6fb359e07b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:17.709176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e11b15-e656-426e-9c7c-6fb359e07b37 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:17.719418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1230/2450] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:18.025322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331fded-73bb-41fd-af3f-90777f3909d1 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:18.026780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8331fded-73bb-41fd-af3f-90777f3909d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:18.040496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331fded-73bb-41fd-af3f-90777f3909d1 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:18.054663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:18.055690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:18.055973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:18.056246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] PATH_INFO: `/v3/projects/c9502a2adbf248f8a933f8c0e97334de` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:18.057646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9502a2adbf248f8a933f8c0e97334de)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:18.059736 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:18.107089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9502a2adbf248f8a933f8c0e97334de', 'request_id': 'req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.113037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9502a2adbf248f8a933f8c0e97334de', 'request_id': 'req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.122250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9502a2adbf248f8a933f8c0e97334de', 'request_id': 'req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.132500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] The token cache is being invalidate because project c9502a2adbf248f8a933f8c0e97334de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:18.132783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.133443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.135003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1221/2451] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:18 2022] DELETE /identity/v3/projects/c9502a2adbf248f8a933f8c0e97334de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:18.139162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11b15-e656-426e-9c7c-6fb359e07b37 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:18.148761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11b15-e656-426e-9c7c-6fb359e07b37 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:18.209959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:18.211157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:18.211440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:18.211661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] PATH_INFO: `/v3/users/ffb6ed9e3b6948e4a64d5b81c33ec711` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:18.213013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb6ed9e3b6948e4a64d5b81c33ec711)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:18.215096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:18.274097 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb6ed9e3b6948e4a64d5b81c33ec711'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.284504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb6ed9e3b6948e4a64d5b81c33ec711'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.285088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb6ed9e3b6948e4a64d5b81c33ec711'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.285953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb6ed9e3b6948e4a64d5b81c33ec711'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.294558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2fccb70a-32ca-42a3-a5b2-e51861dc4c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb6ed9e3b6948e4a64d5b81c33ec711'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.313955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1231/2452] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:18 2022] DELETE /identity/v3/users/ffb6ed9e3b6948e4a64d5b81c33ec711 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:18.703416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:18.705750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:18.720960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a5cf1-aa90-4cce-8bd2-ee70924c2dbb admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:18.801003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:18.801927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:18.802274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:18.802464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] PATH_INFO: `/v3/projects/edab66b6934a4a27ae191043bdd05c41` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:18.803857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=edab66b6934a4a27ae191043bdd05c41)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:18.805792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:18.850199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edab66b6934a4a27ae191043bdd05c41', 'request_id': 'req-934188a5-d23e-479c-ae27-65bc52177c1e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.856163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edab66b6934a4a27ae191043bdd05c41', 'request_id': 'req-934188a5-d23e-479c-ae27-65bc52177c1e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.865927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edab66b6934a4a27ae191043bdd05c41', 'request_id': 'req-934188a5-d23e-479c-ae27-65bc52177c1e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.877421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] The token cache is being invalidate because project edab66b6934a4a27ae191043bdd05c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:18.877715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.878427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-934188a5-d23e-479c-ae27-65bc52177c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:18.880021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1222/2453] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:18 2022] DELETE /identity/v3/projects/edab66b6934a4a27ae191043bdd05c41 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:18.885437 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac5bf-1c65-4252-bd74-d6b35019e088 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:18.885746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac5bf-1c65-4252-bd74-d6b35019e088 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:18.886067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac5bf-1c65-4252-bd74-d6b35019e088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:18.904007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-2a8ac5bf-1c65-4252-bd74-d6b35019e088 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:18.905169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-2a8ac5bf-1c65-4252-bd74-d6b35019e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:18.966109 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1232/2454] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:18.974006 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4fed8-00ac-446a-b025-6645835ba6a0 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:18.974302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4fed8-00ac-446a-b025-6645835ba6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:18.974568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4fed8-00ac-446a-b025-6645835ba6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:18.993527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8bc4fed8-00ac-446a-b025-6645835ba6a0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:18.994719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8bc4fed8-00ac-446a-b025-6645835ba6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:19.003285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1223/2455] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:19.007865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac5bf-1c65-4252-bd74-d6b35019e088 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.017791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac5bf-1c65-4252-bd74-d6b35019e088 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.023163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d24a1-3f05-40ff-9081-5db46d05bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.023723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d24a1-3f05-40ff-9081-5db46d05bdef admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.024001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d24a1-3f05-40ff-9081-5db46d05bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.024269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d24a1-3f05-40ff-9081-5db46d05bdef admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.024993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d24a1-3f05-40ff-9081-5db46d05bdef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:19.025278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d24a1-3f05-40ff-9081-5db46d05bdef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.026931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d24a1-3f05-40ff-9081-5db46d05bdef admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.038717 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1233/2456] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:19.043307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4fed8-00ac-446a-b025-6645835ba6a0 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.052001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4fed8-00ac-446a-b025-6645835ba6a0 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.056820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d5704-72ec-413a-b405-b2d003b1a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.057499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d5704-72ec-413a-b405-b2d003b1a003 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.057861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d5704-72ec-413a-b405-b2d003b1a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.058016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d5704-72ec-413a-b405-b2d003b1a003 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.058784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d5704-72ec-413a-b405-b2d003b1a003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.060660 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d5704-72ec-413a-b405-b2d003b1a003 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.087487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1224/2457] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:19 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:19.091706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d24a1-3f05-40ff-9081-5db46d05bdef admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.101400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d24a1-3f05-40ff-9081-5db46d05bdef admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.164400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eb076-b417-4a54-b006-ac99e8870f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.165092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eb076-b417-4a54-b006-ac99e8870f35 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.165487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eb076-b417-4a54-b006-ac99e8870f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.165773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eb076-b417-4a54-b006-ac99e8870f35 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.166485 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eb076-b417-4a54-b006-ac99e8870f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.168537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eb076-b417-4a54-b006-ac99e8870f35 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.190543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1234/2458] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:19 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:19.194866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d5704-72ec-413a-b405-b2d003b1a003 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.204954 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d5704-72ec-413a-b405-b2d003b1a003 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.209720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20065497-f6b0-4180-b5b5-cde1944be95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.210459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20065497-f6b0-4180-b5b5-cde1944be95b admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.210807 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20065497-f6b0-4180-b5b5-cde1944be95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.211150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20065497-f6b0-4180-b5b5-cde1944be95b admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.211973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20065497-f6b0-4180-b5b5-cde1944be95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.213682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20065497-f6b0-4180-b5b5-cde1944be95b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.224693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1225/2459] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:19.228651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eb076-b417-4a54-b006-ac99e8870f35 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.238849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eb076-b417-4a54-b006-ac99e8870f35 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.243911 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c560a-1c40-4991-95aa-471af66e36ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.244561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c560a-1c40-4991-95aa-471af66e36ca admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.244849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c560a-1c40-4991-95aa-471af66e36ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.245133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c560a-1c40-4991-95aa-471af66e36ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.245875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c560a-1c40-4991-95aa-471af66e36ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.247461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c560a-1c40-4991-95aa-471af66e36ca admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.257273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1235/2460] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:03:19.261750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20065497-f6b0-4180-b5b5-cde1944be95b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.272245 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20065497-f6b0-4180-b5b5-cde1944be95b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.277642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22876547-8a28-4517-8671-cd39f19f6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.278731 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22876547-8a28-4517-8671-cd39f19f6e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.279062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22876547-8a28-4517-8671-cd39f19f6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.279345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22876547-8a28-4517-8671-cd39f19f6e6b admin admin] PATH_INFO: `/v3/projects/d3c42bc978d34202860fda58501a50ee/users/dcc5c617d2cd4cf5bb018237fc4627f7/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.294866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22876547-8a28-4517-8671-cd39f19f6e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c42bc978d34202860fda58501a50ee, user_id=dcc5c617d2cd4cf5bb018237fc4627f7, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.297628 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22876547-8a28-4517-8671-cd39f19f6e6b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.312364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1226/2461] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:19 2022] PUT /identity/v3/projects/d3c42bc978d34202860fda58501a50ee/users/dcc5c617d2cd4cf5bb018237fc4627f7/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:19.324020 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7b3a-5809-4977-9d92-0e7c97a658f8 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.324587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7b3a-5809-4977-9d92-0e7c97a658f8 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.324587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7b3a-5809-4977-9d92-0e7c97a658f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.352684 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-d9bf7b3a-5809-4977-9d92-0e7c97a658f8 None None] MFA Rules not processed for user `dcc5c617d2cd4cf5bb018237fc4627f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:19.353948 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-d9bf7b3a-5809-4977-9d92-0e7c97a658f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:19.421660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1236/2462] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:19.426405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22876547-8a28-4517-8671-cd39f19f6e6b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.492567 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22876547-8a28-4517-8671-cd39f19f6e6b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.497247 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fce73-5741-4805-9071-ff69d8615767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.497930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fce73-5741-4805-9071-ff69d8615767 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.498207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fce73-5741-4805-9071-ff69d8615767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.499043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fce73-5741-4805-9071-ff69d8615767 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.499779 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fce73-5741-4805-9071-ff69d8615767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.501714 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fce73-5741-4805-9071-ff69d8615767 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.533153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1227/2463] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:19 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:19.534648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7b3a-5809-4977-9d92-0e7c97a658f8 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.545335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7b3a-5809-4977-9d92-0e7c97a658f8 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.601626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba87fc-60d7-4f97-b817-5a70bfdab66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.602297 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba87fc-60d7-4f97-b817-5a70bfdab66a admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.602591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba87fc-60d7-4f97-b817-5a70bfdab66a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.602846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba87fc-60d7-4f97-b817-5a70bfdab66a admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.603531 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba87fc-60d7-4f97-b817-5a70bfdab66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.605540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba87fc-60d7-4f97-b817-5a70bfdab66a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.628327 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1237/2464] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:19 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:19.632510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fce73-5741-4805-9071-ff69d8615767 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.642927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fce73-5741-4805-9071-ff69d8615767 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.648405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2192b66-eb77-4a93-9321-911b6d26037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.649071 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2192b66-eb77-4a93-9321-911b6d26037a admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.649362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2192b66-eb77-4a93-9321-911b6d26037a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.649680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2192b66-eb77-4a93-9321-911b6d26037a admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.650401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2192b66-eb77-4a93-9321-911b6d26037a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.652011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2192b66-eb77-4a93-9321-911b6d26037a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.662764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1228/2465] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:19.667199 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba87fc-60d7-4f97-b817-5a70bfdab66a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.677764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba87fc-60d7-4f97-b817-5a70bfdab66a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.682932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3681c-08d5-4d5a-bf3e-1d4bc60158d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.683863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3681c-08d5-4d5a-bf3e-1d4bc60158d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.684144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3681c-08d5-4d5a-bf3e-1d4bc60158d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.684407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3681c-08d5-4d5a-bf3e-1d4bc60158d3 admin admin] PATH_INFO: `/v3/projects/cedfc79859814bd6a1f9eae3424665e2/users/302c851e829a48c69338d0bf206f43e0/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.699231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3681c-08d5-4d5a-bf3e-1d4bc60158d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cedfc79859814bd6a1f9eae3424665e2, user_id=302c851e829a48c69338d0bf206f43e0, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.701932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3681c-08d5-4d5a-bf3e-1d4bc60158d3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.716236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1238/2466] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:19 2022] PUT /identity/v3/projects/cedfc79859814bd6a1f9eae3424665e2/users/302c851e829a48c69338d0bf206f43e0/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:19.720164 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2192b66-eb77-4a93-9321-911b6d26037a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.730111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2192b66-eb77-4a93-9321-911b6d26037a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.784923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97d5fd-75f6-48c6-94e4-6efe9e9d7022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.785646 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97d5fd-75f6-48c6-94e4-6efe9e9d7022 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.785925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97d5fd-75f6-48c6-94e4-6efe9e9d7022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.786201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97d5fd-75f6-48c6-94e4-6efe9e9d7022 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.786944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97d5fd-75f6-48c6-94e4-6efe9e9d7022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.788533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97d5fd-75f6-48c6-94e4-6efe9e9d7022 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.798023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1229/2467] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:19.802115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3681c-08d5-4d5a-bf3e-1d4bc60158d3 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.812289 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3681c-08d5-4d5a-bf3e-1d4bc60158d3 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:19.816867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a109-d81e-43ca-907f-13d6fd559c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:19.817813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a109-d81e-43ca-907f-13d6fd559c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.818067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a109-d81e-43ca-907f-13d6fd559c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.818336 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a109-d81e-43ca-907f-13d6fd559c3a admin admin] PATH_INFO: `/v3/projects/cedfc79859814bd6a1f9eae3424665e2/users/302c851e829a48c69338d0bf206f43e0/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.820307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a109-d81e-43ca-907f-13d6fd559c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cedfc79859814bd6a1f9eae3424665e2, user_id=302c851e829a48c69338d0bf206f43e0, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:19.822985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a109-d81e-43ca-907f-13d6fd559c3a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:19.833164 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1239/2468] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:19 2022] PUT /identity/v3/projects/cedfc79859814bd6a1f9eae3424665e2/users/302c851e829a48c69338d0bf206f43e0/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:19.843615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99f3d3-5df2-4687-9fed-736db4c03dff None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:19.843908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99f3d3-5df2-4687-9fed-736db4c03dff None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:19.844184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99f3d3-5df2-4687-9fed-736db4c03dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:19.870962 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ae99f3d3-5df2-4687-9fed-736db4c03dff None None] MFA Rules not processed for user `302c851e829a48c69338d0bf206f43e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:19.872166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ae99f3d3-5df2-4687-9fed-736db4c03dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:19.938166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1230/2469] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:19.949644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a109-d81e-43ca-907f-13d6fd559c3a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:19.951415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-4492a109-d81e-43ca-907f-13d6fd559c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:20.006688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a109-d81e-43ca-907f-13d6fd559c3a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:20.010475 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ece04-ff6a-409f-bd67-e2b914f60ca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:20.011121 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ece04-ff6a-409f-bd67-e2b914f60ca1 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:20.011472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ece04-ff6a-409f-bd67-e2b914f60ca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:20.011745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ece04-ff6a-409f-bd67-e2b914f60ca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:20.021169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ece04-ff6a-409f-bd67-e2b914f60ca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:20.022629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ece04-ff6a-409f-bd67-e2b914f60ca1 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:20.032443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1240/2470] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:20.120448 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99f3d3-5df2-4687-9fed-736db4c03dff None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:20.130616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99f3d3-5df2-4687-9fed-736db4c03dff None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:20.134594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72088d-138f-42c5-a90c-05ea08731cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:20.135315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72088d-138f-42c5-a90c-05ea08731cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:20.135655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72088d-138f-42c5-a90c-05ea08731cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:20.136010 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72088d-138f-42c5-a90c-05ea08731cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:20.192291 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72088d-138f-42c5-a90c-05ea08731cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:20.193763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72088d-138f-42c5-a90c-05ea08731cc6 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:20.202420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1231/2471] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:20.691737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d612e-d229-4d33-9db9-e52c0400e817 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:20.692243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d612e-d229-4d33-9db9-e52c0400e817 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:20.692348 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d612e-d229-4d33-9db9-e52c0400e817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:20.712740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-655d612e-d229-4d33-9db9-e52c0400e817 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:20.714022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-655d612e-d229-4d33-9db9-e52c0400e817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:20.774573 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1241/2472] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 19:03:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:20.786579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72088d-138f-42c5-a90c-05ea08731cc6 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:20.787987 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5b72088d-138f-42c5-a90c-05ea08731cc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:20.862572 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72088d-138f-42c5-a90c-05ea08731cc6 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:20.867891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6b2ad-3a40-470f-873e-a29b64f7f3d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:20.868564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6b2ad-3a40-470f-873e-a29b64f7f3d9 service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:20.868837 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6b2ad-3a40-470f-873e-a29b64f7f3d9 service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:20.869102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6b2ad-3a40-470f-873e-a29b64f7f3d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:20.878280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6b2ad-3a40-470f-873e-a29b64f7f3d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:20.879931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6b2ad-3a40-470f-873e-a29b64f7f3d9 service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:20.890416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1232/2473] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:03:21.425157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67835b88-4804-40fa-9954-cf82c379731d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:21.425473 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67835b88-4804-40fa-9954-cf82c379731d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:21.425757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67835b88-4804-40fa-9954-cf82c379731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:21.443836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-67835b88-4804-40fa-9954-cf82c379731d None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:21.445047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-67835b88-4804-40fa-9954-cf82c379731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:21.452989 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1242/2474] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 4 19:03:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:21.465530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6b2ad-3a40-470f-873e-a29b64f7f3d9 service swift] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:21.477003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6b2ad-3a40-470f-873e-a29b64f7f3d9 service swift] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:21.483282 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7605ab6-3450-4a2f-a9d6-8f82a5e978c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:21.483930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7605ab6-3450-4a2f-a9d6-8f82a5e978c0 service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:21.484208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7605ab6-3450-4a2f-a9d6-8f82a5e978c0 service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:21.484481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7605ab6-3450-4a2f-a9d6-8f82a5e978c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:21.492988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7605ab6-3450-4a2f-a9d6-8f82a5e978c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:21.494618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7605ab6-3450-4a2f-a9d6-8f82a5e978c0 service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:21.502896 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1233/2475] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:03:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:03:21.709499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c63319-f87c-4739-b78d-dda1a2e7e3f0 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:21.710357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c63319-f87c-4739-b78d-dda1a2e7e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:21.710622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c63319-f87c-4739-b78d-dda1a2e7e3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:21.729095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-15c63319-f87c-4739-b78d-dda1a2e7e3f0 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:21.730414 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-15c63319-f87c-4739-b78d-dda1a2e7e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:21.738157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1243/2476] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 19:03:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:21.752297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7605ab6-3450-4a2f-a9d6-8f82a5e978c0 service swift] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:21.765977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7605ab6-3450-4a2f-a9d6-8f82a5e978c0 service swift] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:21.772208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b9e8d-9f15-4d6e-9227-1aabe565a2be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:21.772855 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b9e8d-9f15-4d6e-9227-1aabe565a2be service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:21.773461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b9e8d-9f15-4d6e-9227-1aabe565a2be service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:21.773854 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b9e8d-9f15-4d6e-9227-1aabe565a2be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:21.782682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b9e8d-9f15-4d6e-9227-1aabe565a2be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:21.784287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b9e8d-9f15-4d6e-9227-1aabe565a2be service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:21.792547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1234/2477] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:03:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:03:21.813582 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c63319-f87c-4739-b78d-dda1a2e7e3f0 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:21.814898 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-15c63319-f87c-4739-b78d-dda1a2e7e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:21.884129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c63319-f87c-4739-b78d-dda1a2e7e3f0 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:21.890317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:21.891231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:21.891712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:21.891993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] PATH_INFO: `/v3/users/8e3eaa0ac0204cef88b311ff8458d601` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:21.893260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3eaa0ac0204cef88b311ff8458d601)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:21.895507 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:21.940815 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3eaa0ac0204cef88b311ff8458d601'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:21.947757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3eaa0ac0204cef88b311ff8458d601'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:21.948432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3eaa0ac0204cef88b311ff8458d601'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:21.949101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3eaa0ac0204cef88b311ff8458d601'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:21.957014 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3eaa0ac0204cef88b311ff8458d601'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:21.976194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1244/2478] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:21 2022] DELETE /identity/v3/users/8e3eaa0ac0204cef88b311ff8458d601 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:21.980772 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfcb0-48b9-4c48-ba11-42020b0d0bef None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:21.981066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfcb0-48b9-4c48-ba11-42020b0d0bef None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:21.981404 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfcb0-48b9-4c48-ba11-42020b0d0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:21.999131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-bcfbfcb0-48b9-4c48-ba11-42020b0d0bef None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:22.000331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-bcfbfcb0-48b9-4c48-ba11-42020b0d0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:22.055722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1235/2479] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:22.066077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:22.067554 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:22.129742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b652df-782b-42aa-b04c-ae80d3405df1 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:22.130033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b652df-782b-42aa-b04c-ae80d3405df1 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:22.130316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b652df-782b-42aa-b04c-ae80d3405df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:22.134520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d06c3-1534-4073-94d5-07bababd31dc admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:22.140613 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1285e0e-f8fa-4685-8ff5-ec16d182d4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:22.141300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1285e0e-f8fa-4685-8ff5-ec16d182d4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:22.141601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1285e0e-f8fa-4685-8ff5-ec16d182d4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:22.141876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1285e0e-f8fa-4685-8ff5-ec16d182d4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:22.148864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-63b652df-782b-42aa-b04c-ae80d3405df1 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:22.150153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-63b652df-782b-42aa-b04c-ae80d3405df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:22.153675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1285e0e-f8fa-4685-8ff5-ec16d182d4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:22.156092 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1285e0e-f8fa-4685-8ff5-ec16d182d4f9 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:22.177493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1245/2480] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:22.208269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1236/2481] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 4 19:03:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:22.222227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1285e0e-f8fa-4685-8ff5-ec16d182d4f9 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:22.223826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c1285e0e-f8fa-4685-8ff5-ec16d182d4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:22.311964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1285e0e-f8fa-4685-8ff5-ec16d182d4f9 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:22.317656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae7b32-079d-4d2c-80dd-9475f40ae8e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:22.318240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae7b32-079d-4d2c-80dd-9475f40ae8e2 service swift] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:22.318649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae7b32-079d-4d2c-80dd-9475f40ae8e2 service swift] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:22.318849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae7b32-079d-4d2c-80dd-9475f40ae8e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:22.328706 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae7b32-079d-4d2c-80dd-9475f40ae8e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:22.330385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae7b32-079d-4d2c-80dd-9475f40ae8e2 service swift] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:22.339634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1246/2482] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:03:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:03:22.558784 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b652df-782b-42aa-b04c-ae80d3405df1 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:22.562362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-63b652df-782b-42aa-b04c-ae80d3405df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:22.588080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b652df-782b-42aa-b04c-ae80d3405df1 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:22.594471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:22.596160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:22.597028 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:22.597776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] PATH_INFO: `/v3/projects/3387c7080b8f4414b6eadf0857b64888` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:22.601577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3387c7080b8f4414b6eadf0857b64888)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:22.603664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:22.664309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3387c7080b8f4414b6eadf0857b64888', 'request_id': 'req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.673170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3387c7080b8f4414b6eadf0857b64888', 'request_id': 'req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.684319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3387c7080b8f4414b6eadf0857b64888', 'request_id': 'req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.696089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] The token cache is being invalidate because project 3387c7080b8f4414b6eadf0857b64888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:22.696326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.697398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.698921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1237/2483] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:22 2022] DELETE /identity/v3/projects/3387c7080b8f4414b6eadf0857b64888 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:22.705029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae7b32-079d-4d2c-80dd-9475f40ae8e2 service swift] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:22.715700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae7b32-079d-4d2c-80dd-9475f40ae8e2 service swift] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:22.769826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:22.770724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:22.771011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:22.771289 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] PATH_INFO: `/v3/users/8734cfab719545f789a1de4adf6dd53b` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:22.772629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8734cfab719545f789a1de4adf6dd53b)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:22.774672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:22.825742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8734cfab719545f789a1de4adf6dd53b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.834115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8734cfab719545f789a1de4adf6dd53b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.835000 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8734cfab719545f789a1de4adf6dd53b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.835963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8734cfab719545f789a1de4adf6dd53b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.844518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e4032a72-eae4-43dc-9157-2251d58bb652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8734cfab719545f789a1de4adf6dd53b'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:22.872205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1247/2484] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:22 2022] DELETE /identity/v3/users/8734cfab719545f789a1de4adf6dd53b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:23.188332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:23.189855 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:23.219992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad985c-93c1-4bb1-8b6f-a7a9035473e2 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:23.302134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:23.303136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:23.303495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:23.303836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] PATH_INFO: `/v3/projects/c4eb334181fa4ae29fbf8e535731fd5e` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:23.305341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4eb334181fa4ae29fbf8e535731fd5e)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:23.308982 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:23.373612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4eb334181fa4ae29fbf8e535731fd5e', 'request_id': 'req-f0350243-7224-4ea6-b908-85eca1734d3a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:23.380825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4eb334181fa4ae29fbf8e535731fd5e', 'request_id': 'req-f0350243-7224-4ea6-b908-85eca1734d3a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:23.394940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4eb334181fa4ae29fbf8e535731fd5e', 'request_id': 'req-f0350243-7224-4ea6-b908-85eca1734d3a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:23.407104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] The token cache is being invalidate because project c4eb334181fa4ae29fbf8e535731fd5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:23.407374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:23.408027 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f0350243-7224-4ea6-b908-85eca1734d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:23.409756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1238/2485] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:23 2022] DELETE /identity/v3/projects/c4eb334181fa4ae29fbf8e535731fd5e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:23.414511 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069704-17a3-4ace-9126-20cebccab796 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:23.414980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069704-17a3-4ace-9126-20cebccab796 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:23.415264 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069704-17a3-4ace-9126-20cebccab796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:23.435460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c9069704-17a3-4ace-9126-20cebccab796 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:23.437198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c9069704-17a3-4ace-9126-20cebccab796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:23.541076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1248/2486] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:23.551689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdd00-0f56-4aef-a1fa-cc1a2803416b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:23.551977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdd00-0f56-4aef-a1fa-cc1a2803416b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:23.552256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdd00-0f56-4aef-a1fa-cc1a2803416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:23.578972 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-865bdd00-0f56-4aef-a1fa-cc1a2803416b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:23.580336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-865bdd00-0f56-4aef-a1fa-cc1a2803416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:23.589742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1239/2487] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:23.594521 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9069704-17a3-4ace-9126-20cebccab796 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:23.604969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9069704-17a3-4ace-9126-20cebccab796 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:23.609586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87126b55-7537-40af-9196-2191e6cdaa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:23.610267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87126b55-7537-40af-9196-2191e6cdaa81 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:23.610551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87126b55-7537-40af-9196-2191e6cdaa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:23.610829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87126b55-7537-40af-9196-2191e6cdaa81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:23.611568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87126b55-7537-40af-9196-2191e6cdaa81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:23.611880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87126b55-7537-40af-9196-2191e6cdaa81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:23.613649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87126b55-7537-40af-9196-2191e6cdaa81 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:23.626272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1249/2488] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:23.631149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdd00-0f56-4aef-a1fa-cc1a2803416b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:23.641340 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdd00-0f56-4aef-a1fa-cc1a2803416b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:23.652001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0eba4-8c2a-4a78-be28-472bb3632ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:23.652747 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0eba4-8c2a-4a78-be28-472bb3632ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:23.653188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0eba4-8c2a-4a78-be28-472bb3632ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:23.653688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0eba4-8c2a-4a78-be28-472bb3632ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:23.654325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0eba4-8c2a-4a78-be28-472bb3632ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:23.656384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0eba4-8c2a-4a78-be28-472bb3632ba3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:23.747877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1240/2489] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:23 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:23.753647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87126b55-7537-40af-9196-2191e6cdaa81 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:23.797211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87126b55-7537-40af-9196-2191e6cdaa81 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:23.856807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe999-31b6-4806-a321-99cad3d3fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:23.857499 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe999-31b6-4806-a321-99cad3d3fd94 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:23.858091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe999-31b6-4806-a321-99cad3d3fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:23.858581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe999-31b6-4806-a321-99cad3d3fd94 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:23.859284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abe999-31b6-4806-a321-99cad3d3fd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:23.861263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abe999-31b6-4806-a321-99cad3d3fd94 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:23.891624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1250/2490] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:23 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:23.893519 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0eba4-8c2a-4a78-be28-472bb3632ba3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:23.904436 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0eba4-8c2a-4a78-be28-472bb3632ba3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:23.908923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d356c2a-bfe3-4d61-b07e-90ceb085377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:23.909621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d356c2a-bfe3-4d61-b07e-90ceb085377a admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:23.909898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d356c2a-bfe3-4d61-b07e-90ceb085377a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:23.910238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d356c2a-bfe3-4d61-b07e-90ceb085377a admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:23.911018 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d356c2a-bfe3-4d61-b07e-90ceb085377a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:23.912666 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d356c2a-bfe3-4d61-b07e-90ceb085377a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:23.926129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1241/2491] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:23.930114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe999-31b6-4806-a321-99cad3d3fd94 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:23.940039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe999-31b6-4806-a321-99cad3d3fd94 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:23.944814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46175f9b-ce37-44df-93b5-07949b48825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:23.945487 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175f9b-ce37-44df-93b5-07949b48825e admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:23.945766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175f9b-ce37-44df-93b5-07949b48825e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:23.946035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175f9b-ce37-44df-93b5-07949b48825e admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:23.946765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46175f9b-ce37-44df-93b5-07949b48825e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:23.948357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46175f9b-ce37-44df-93b5-07949b48825e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:23.958596 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1251/2492] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:23.962813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d356c2a-bfe3-4d61-b07e-90ceb085377a admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:23.972657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d356c2a-bfe3-4d61-b07e-90ceb085377a admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:23.978223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f13d53-6154-4682-a7a8-f2d2beab6476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:23.979178 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f13d53-6154-4682-a7a8-f2d2beab6476 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:23.979467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f13d53-6154-4682-a7a8-f2d2beab6476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:23.979740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f13d53-6154-4682-a7a8-f2d2beab6476 admin admin] PATH_INFO: `/v3/projects/f70b937a2d4d42088d536cf8d0ed4639/users/63dcda05514c4a8699466b6b58159c88/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:23.996187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f13d53-6154-4682-a7a8-f2d2beab6476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70b937a2d4d42088d536cf8d0ed4639, user_id=63dcda05514c4a8699466b6b58159c88, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:23.998934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f13d53-6154-4682-a7a8-f2d2beab6476 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:24.012040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1242/2493] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:23 2022] PUT /identity/v3/projects/f70b937a2d4d42088d536cf8d0ed4639/users/63dcda05514c4a8699466b6b58159c88/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:24.022976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c69f03-3f7c-4712-980b-61614b0be4c5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:24.023292 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c69f03-3f7c-4712-980b-61614b0be4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:24.023570 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c69f03-3f7c-4712-980b-61614b0be4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:24.050268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-f3c69f03-3f7c-4712-980b-61614b0be4c5 None None] MFA Rules not processed for user `63dcda05514c4a8699466b6b58159c88`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:24.051518 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-f3c69f03-3f7c-4712-980b-61614b0be4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:24.127189 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1252/2494] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:24.138800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f13d53-6154-4682-a7a8-f2d2beab6476 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:24.141205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-36f13d53-6154-4682-a7a8-f2d2beab6476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:24.198927 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f13d53-6154-4682-a7a8-f2d2beab6476 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:24.203926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfebf67-20f4-4d0c-88ab-5c4152e6f11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:24.205156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfebf67-20f4-4d0c-88ab-5c4152e6f11e service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:24.205706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfebf67-20f4-4d0c-88ab-5c4152e6f11e service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:24.206487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfebf67-20f4-4d0c-88ab-5c4152e6f11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:24.217216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfebf67-20f4-4d0c-88ab-5c4152e6f11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:24.219534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfebf67-20f4-4d0c-88ab-5c4152e6f11e service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:24.229170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1243/2495] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:24.248536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c69f03-3f7c-4712-980b-61614b0be4c5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:24.315756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c69f03-3f7c-4712-980b-61614b0be4c5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:24.320601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:24.321515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:24.321794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:24.322076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] PATH_INFO: `/v3/users/63dcda05514c4a8699466b6b58159c88` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:24.324019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63dcda05514c4a8699466b6b58159c88)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:24.326860 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:24.379183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63dcda05514c4a8699466b6b58159c88'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.386316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63dcda05514c4a8699466b6b58159c88'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.387635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63dcda05514c4a8699466b6b58159c88'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.388299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63dcda05514c4a8699466b6b58159c88'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.397073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63dcda05514c4a8699466b6b58159c88'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.414356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1253/2496] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:24 2022] DELETE /identity/v3/users/63dcda05514c4a8699466b6b58159c88 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:24.419184 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54411905-1b59-45a3-b5e0-b0fce2330e71 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:24.419473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54411905-1b59-45a3-b5e0-b0fce2330e71 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:24.419751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54411905-1b59-45a3-b5e0-b0fce2330e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:24.436659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-54411905-1b59-45a3-b5e0-b0fce2330e71 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:24.437891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-54411905-1b59-45a3-b5e0-b0fce2330e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:24.497239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1244/2497] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:24.506528 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:24.508048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:24.556175 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54411905-1b59-45a3-b5e0-b0fce2330e71 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:24.557640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-54411905-1b59-45a3-b5e0-b0fce2330e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:24.564670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070248c-f668-43de-956c-6cb048660d0f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:24.568377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8250ff9-da7d-4309-8543-310f4288c10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:24.569028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8250ff9-da7d-4309-8543-310f4288c10d service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:24.569338 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8250ff9-da7d-4309-8543-310f4288c10d service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:24.569617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8250ff9-da7d-4309-8543-310f4288c10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:24.569882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54411905-1b59-45a3-b5e0-b0fce2330e71 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:24.574778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:24.575663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:24.575924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:24.576187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] PATH_INFO: `/v3/users/d1f83559272d4650a12e94f40d5db982` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:24.577424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f83559272d4650a12e94f40d5db982)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:24.578846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8250ff9-da7d-4309-8543-310f4288c10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:24.579388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:24.580313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8250ff9-da7d-4309-8543-310f4288c10d service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:24.589921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1254/2498] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:24.630869 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f83559272d4650a12e94f40d5db982'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.641036 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f83559272d4650a12e94f40d5db982'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.642077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f83559272d4650a12e94f40d5db982'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.642945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f83559272d4650a12e94f40d5db982'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.652385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f83559272d4650a12e94f40d5db982'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.673834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1245/2499] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:24 2022] DELETE /identity/v3/users/d1f83559272d4650a12e94f40d5db982 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:24.678379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a799f51-e841-4118-a529-996264d511e9 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:24.678671 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a799f51-e841-4118-a529-996264d511e9 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:24.678953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a799f51-e841-4118-a529-996264d511e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:24.698132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5a799f51-e841-4118-a529-996264d511e9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:24.699385 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5a799f51-e841-4118-a529-996264d511e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:24.779364 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1255/2500] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:24.793971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:24.795522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:24.854273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493ab58-6683-427e-a764-9c1d8f6386f6 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:24.858569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86c4e9-1f4f-4c6b-8fc7-a77a1c0ef5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:24.859328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86c4e9-1f4f-4c6b-8fc7-a77a1c0ef5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:24.859653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86c4e9-1f4f-4c6b-8fc7-a77a1c0ef5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:24.860000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86c4e9-1f4f-4c6b-8fc7-a77a1c0ef5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:24.870758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86c4e9-1f4f-4c6b-8fc7-a77a1c0ef5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:24.872487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86c4e9-1f4f-4c6b-8fc7-a77a1c0ef5d1 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:24.872817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a799f51-e841-4118-a529-996264d511e9 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:24.874463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5a799f51-e841-4118-a529-996264d511e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:24.884351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1246/2501] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:24.892371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a799f51-e841-4118-a529-996264d511e9 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:24.897172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:24.898093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:24.898375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:24.898652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] PATH_INFO: `/v3/projects/f70b937a2d4d42088d536cf8d0ed4639` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:24.899848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70b937a2d4d42088d536cf8d0ed4639)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:24.902966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:24.966307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70b937a2d4d42088d536cf8d0ed4639', 'request_id': 'req-925a158e-2f2e-48cb-856d-766d3ada9507'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.975756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70b937a2d4d42088d536cf8d0ed4639', 'request_id': 'req-925a158e-2f2e-48cb-856d-766d3ada9507'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.983634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70b937a2d4d42088d536cf8d0ed4639', 'request_id': 'req-925a158e-2f2e-48cb-856d-766d3ada9507'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.998676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] The token cache is being invalidate because project f70b937a2d4d42088d536cf8d0ed4639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:24.999029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:24.999715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.001584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1256/2502] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:24 2022] DELETE /identity/v3/projects/f70b937a2d4d42088d536cf8d0ed4639 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:25.006686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa72dc3-b82e-4f3e-8d00-1b60b4070feb None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.007008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa72dc3-b82e-4f3e-8d00-1b60b4070feb None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.007253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa72dc3-b82e-4f3e-8d00-1b60b4070feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.025696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-4aa72dc3-b82e-4f3e-8d00-1b60b4070feb None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:25.026985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4aa72dc3-b82e-4f3e-8d00-1b60b4070feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.071462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.073544 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.098694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1247/2503] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:25.099651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa72dc3-b82e-4f3e-8d00-1b60b4070feb None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.100992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4aa72dc3-b82e-4f3e-8d00-1b60b4070feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.112683 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa72dc3-b82e-4f3e-8d00-1b60b4070feb None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.117634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.118513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.118801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.119067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] PATH_INFO: `/v3/users/dcc5c617d2cd4cf5bb018237fc4627f7` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.120280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc5c617d2cd4cf5bb018237fc4627f7)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.122322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.145351 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a158e-2f2e-48cb-856d-766d3ada9507 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.150812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.151688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.151997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.152352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] PATH_INFO: `/v3/projects/1de3018f59464b10acbc27fcea3956d2` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.153647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de3018f59464b10acbc27fcea3956d2)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.155784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.169722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc5c617d2cd4cf5bb018237fc4627f7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.176246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc5c617d2cd4cf5bb018237fc4627f7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.176937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc5c617d2cd4cf5bb018237fc4627f7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.177563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc5c617d2cd4cf5bb018237fc4627f7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.186105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1a3aaa77-1a07-42d6-b734-58f1ebe33764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc5c617d2cd4cf5bb018237fc4627f7'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.203147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1248/2504] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:25 2022] DELETE /identity/v3/users/dcc5c617d2cd4cf5bb018237fc4627f7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:25.203783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de3018f59464b10acbc27fcea3956d2', 'request_id': 'req-a7ab830e-1095-46bf-8911-581da926a14d'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.204563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426baf62-4be5-4ddc-a3e6-6a5be25dc06f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.204840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426baf62-4be5-4ddc-a3e6-6a5be25dc06f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.205111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426baf62-4be5-4ddc-a3e6-6a5be25dc06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.213412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de3018f59464b10acbc27fcea3956d2', 'request_id': 'req-a7ab830e-1095-46bf-8911-581da926a14d'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.219883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de3018f59464b10acbc27fcea3956d2', 'request_id': 'req-a7ab830e-1095-46bf-8911-581da926a14d'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.223642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-426baf62-4be5-4ddc-a3e6-6a5be25dc06f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:25.224850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-426baf62-4be5-4ddc-a3e6-6a5be25dc06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.229800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] The token cache is being invalidate because project 1de3018f59464b10acbc27fcea3956d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:25.230201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.230852 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-a7ab830e-1095-46bf-8911-581da926a14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:25.232397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1257/2505] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:25 2022] DELETE /identity/v3/projects/1de3018f59464b10acbc27fcea3956d2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:25.233710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01615932-5946-474c-b273-7b63eb8731ec None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.233990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01615932-5946-474c-b273-7b63eb8731ec None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.234261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01615932-5946-474c-b273-7b63eb8731ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.252816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-01615932-5946-474c-b273-7b63eb8731ec None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:25.254098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-01615932-5946-474c-b273-7b63eb8731ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.293372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1249/2506] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:25.298196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426baf62-4be5-4ddc-a3e6-6a5be25dc06f None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.308621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426baf62-4be5-4ddc-a3e6-6a5be25dc06f None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.313708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fcc27-5f02-49b0-97f9-27cd276d9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.314405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fcc27-5f02-49b0-97f9-27cd276d9ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.314680 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fcc27-5f02-49b0-97f9-27cd276d9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.314955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fcc27-5f02-49b0-97f9-27cd276d9ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.315697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fcc27-5f02-49b0-97f9-27cd276d9ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:25.316007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fcc27-5f02-49b0-97f9-27cd276d9ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.317693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fcc27-5f02-49b0-97f9-27cd276d9ad3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.318810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1258/2507] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:25.329396 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01615932-5946-474c-b273-7b63eb8731ec None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.334194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1250/2508] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 19:03:25.334419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-01615932-5946-474c-b273-7b63eb8731ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.335306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fcc27-5f02-49b0-97f9-27cd276d9ad3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.346226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fcc27-5f02-49b0-97f9-27cd276d9ad3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.351217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2bd48-c247-452d-8e22-c3f51cbd21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.351878 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2bd48-c247-452d-8e22-c3f51cbd21e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.352158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2bd48-c247-452d-8e22-c3f51cbd21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.352432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2bd48-c247-452d-8e22-c3f51cbd21e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.353320 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2bd48-c247-452d-8e22-c3f51cbd21e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.355345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2bd48-c247-452d-8e22-c3f51cbd21e0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.388045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1251/2509] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:25 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:25.389578 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2bd48-c247-452d-8e22-c3f51cbd21e0 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.397650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01615932-5946-474c-b273-7b63eb8731ec None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.454704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269cd09-45c4-43b9-b47f-47e07b012e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.455397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269cd09-45c4-43b9-b47f-47e07b012e31 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.455677 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269cd09-45c4-43b9-b47f-47e07b012e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.455949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269cd09-45c4-43b9-b47f-47e07b012e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.479356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2bd48-c247-452d-8e22-c3f51cbd21e0 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.484119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee97f6-36f3-4aaf-b81b-886502494ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.484793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee97f6-36f3-4aaf-b81b-886502494ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.485067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee97f6-36f3-4aaf-b81b-886502494ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.485365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee97f6-36f3-4aaf-b81b-886502494ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.486083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee97f6-36f3-4aaf-b81b-886502494ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.488055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee97f6-36f3-4aaf-b81b-886502494ee7 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.508183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1252/2510] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:25 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:25.512458 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee97f6-36f3-4aaf-b81b-886502494ee7 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.521843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269cd09-45c4-43b9-b47f-47e07b012e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.522169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee97f6-36f3-4aaf-b81b-886502494ee7 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.523392 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269cd09-45c4-43b9-b47f-47e07b012e31 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.526889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8137a-0f36-4c94-a55e-5f3fad84e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.527544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8137a-0f36-4c94-a55e-5f3fad84e2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.527823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8137a-0f36-4c94-a55e-5f3fad84e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.528098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8137a-0f36-4c94-a55e-5f3fad84e2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.528851 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8137a-0f36-4c94-a55e-5f3fad84e2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.530483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8137a-0f36-4c94-a55e-5f3fad84e2c0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.533046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1259/2511] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:25.540148 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1253/2512] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:03:25.544166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269cd09-45c4-43b9-b47f-47e07b012e31 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.556067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269cd09-45c4-43b9-b47f-47e07b012e31 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.561696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869c93d-ab22-4684-a5fd-cfd21c57b87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.562376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869c93d-ab22-4684-a5fd-cfd21c57b87d admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.562659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869c93d-ab22-4684-a5fd-cfd21c57b87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.562937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869c93d-ab22-4684-a5fd-cfd21c57b87d admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.563741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869c93d-ab22-4684-a5fd-cfd21c57b87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.565627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869c93d-ab22-4684-a5fd-cfd21c57b87d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.576059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1260/2513] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:25.580749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8137a-0f36-4c94-a55e-5f3fad84e2c0 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.584777 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cc271-4a9a-4cb1-a765-cd71cc07da56 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.585386 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cc271-4a9a-4cb1-a765-cd71cc07da56 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.585668 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cc271-4a9a-4cb1-a765-cd71cc07da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.595921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8137a-0f36-4c94-a55e-5f3fad84e2c0 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.600955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005e98f-54b2-4230-8b80-b05bb7a3a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.602033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005e98f-54b2-4230-8b80-b05bb7a3a5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.602312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005e98f-54b2-4230-8b80-b05bb7a3a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.602592 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005e98f-54b2-4230-8b80-b05bb7a3a5a7 admin admin] PATH_INFO: `/v3/projects/fc21b1af37d945e992eeadb421cf3314/users/528bf19839fb49d4827f475071aa3718/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.610778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-1d8cc271-4a9a-4cb1-a765-cd71cc07da56 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:25.612607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1d8cc271-4a9a-4cb1-a765-cd71cc07da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.618359 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005e98f-54b2-4230-8b80-b05bb7a3a5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc21b1af37d945e992eeadb421cf3314, user_id=528bf19839fb49d4827f475071aa3718, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.621128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005e98f-54b2-4230-8b80-b05bb7a3a5a7 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.637620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1254/2514] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:25 2022] PUT /identity/v3/projects/fc21b1af37d945e992eeadb421cf3314/users/528bf19839fb49d4827f475071aa3718/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:25.648761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff09a52-a173-47b9-82c4-e47d0905ab24 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.649128 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff09a52-a173-47b9-82c4-e47d0905ab24 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.649445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff09a52-a173-47b9-82c4-e47d0905ab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.675650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1261/2515] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 4 19:03:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:25.678231 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-cff09a52-a173-47b9-82c4-e47d0905ab24 None None] MFA Rules not processed for user `528bf19839fb49d4827f475071aa3718`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:25.679446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cff09a52-a173-47b9-82c4-e47d0905ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.694394 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cc271-4a9a-4cb1-a765-cd71cc07da56 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.695813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1d8cc271-4a9a-4cb1-a765-cd71cc07da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.748755 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1255/2516] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:25.760586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff09a52-a173-47b9-82c4-e47d0905ab24 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.762015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cff09a52-a173-47b9-82c4-e47d0905ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.772555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cc271-4a9a-4cb1-a765-cd71cc07da56 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.839414 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70903c30-e958-4220-97e1-abff00d3605c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.840084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff09a52-a173-47b9-82c4-e47d0905ab24 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.840191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70903c30-e958-4220-97e1-abff00d3605c service swift] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.840345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70903c30-e958-4220-97e1-abff00d3605c service swift] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.840614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70903c30-e958-4220-97e1-abff00d3605c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.844782 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462da1-fcd7-4d0f-8906-9919c756de5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.845560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462da1-fcd7-4d0f-8906-9919c756de5e service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.845906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462da1-fcd7-4d0f-8906-9919c756de5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.846244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462da1-fcd7-4d0f-8906-9919c756de5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.863871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e462da1-fcd7-4d0f-8906-9919c756de5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.865925 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e462da1-fcd7-4d0f-8906-9919c756de5e service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.877268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1256/2517] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:25.878617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462da1-fcd7-4d0f-8906-9919c756de5e service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:25.880069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2e462da1-fcd7-4d0f-8906-9919c756de5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:25.925551 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70903c30-e958-4220-97e1-abff00d3605c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.927197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70903c30-e958-4220-97e1-abff00d3605c service swift] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:25.936868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1262/2518] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:03:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:03:25.975711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462da1-fcd7-4d0f-8906-9919c756de5e service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:25.980919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:25.981903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:25.982172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:25.982486 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] PATH_INFO: `/v3/projects/d3c42bc978d34202860fda58501a50ee` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:25.983910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c42bc978d34202860fda58501a50ee)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:25.986861 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:26.049167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c42bc978d34202860fda58501a50ee', 'request_id': 'req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.056392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c42bc978d34202860fda58501a50ee', 'request_id': 'req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.066540 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c42bc978d34202860fda58501a50ee', 'request_id': 'req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.080227 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] The token cache is being invalidate because project d3c42bc978d34202860fda58501a50ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:26.080501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.081158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.083036 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1257/2519] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:25 2022] DELETE /identity/v3/projects/d3c42bc978d34202860fda58501a50ee => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:26.087106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70903c30-e958-4220-97e1-abff00d3605c service swift] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:26.099892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70903c30-e958-4220-97e1-abff00d3605c service swift] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:26.178593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:26.179749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:26.180202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:26.180624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] PATH_INFO: `/v3/users/302c851e829a48c69338d0bf206f43e0` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:26.181977 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302c851e829a48c69338d0bf206f43e0)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:26.184248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:26.246366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302c851e829a48c69338d0bf206f43e0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.254750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302c851e829a48c69338d0bf206f43e0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.255704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302c851e829a48c69338d0bf206f43e0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.256525 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302c851e829a48c69338d0bf206f43e0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.266827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5cb933da-3dd1-41b6-b64f-4a9b20ef2bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302c851e829a48c69338d0bf206f43e0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.284672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1263/2520] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:26 2022] DELETE /identity/v3/users/302c851e829a48c69338d0bf206f43e0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:26.559958 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:26.561765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:26.580257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7a1b-f2d3-4132-adc3-927e9708c89b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:26.637118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:26.638055 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:26.638315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:26.638614 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] PATH_INFO: `/v3/projects/cedfc79859814bd6a1f9eae3424665e2` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:26.639962 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cedfc79859814bd6a1f9eae3424665e2)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:26.641945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:26.691532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedfc79859814bd6a1f9eae3424665e2', 'request_id': 'req-384cd955-1986-4350-b56b-5069bd373ce5'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.697401 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedfc79859814bd6a1f9eae3424665e2', 'request_id': 'req-384cd955-1986-4350-b56b-5069bd373ce5'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.706396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedfc79859814bd6a1f9eae3424665e2', 'request_id': 'req-384cd955-1986-4350-b56b-5069bd373ce5'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.716557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] The token cache is being invalidate because project cedfc79859814bd6a1f9eae3424665e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:26.716856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.717593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-384cd955-1986-4350-b56b-5069bd373ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:26.719144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1258/2521] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:26 2022] DELETE /identity/v3/projects/cedfc79859814bd6a1f9eae3424665e2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:26.724128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3709c93-08ca-4dc0-80db-035f1dfd6760 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:26.724419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3709c93-08ca-4dc0-80db-035f1dfd6760 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:26.724705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3709c93-08ca-4dc0-80db-035f1dfd6760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:26.743158 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-e3709c93-08ca-4dc0-80db-035f1dfd6760 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:26.744366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e3709c93-08ca-4dc0-80db-035f1dfd6760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:26.806592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1264/2522] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:26.815325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cff5e-ff1b-47d1-9bdc-062eba956b67 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:26.815718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cff5e-ff1b-47d1-9bdc-062eba956b67 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:26.815995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cff5e-ff1b-47d1-9bdc-062eba956b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:26.834319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-911cff5e-ff1b-47d1-9bdc-062eba956b67 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:26.835507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-911cff5e-ff1b-47d1-9bdc-062eba956b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:26.845046 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1259/2523] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:26.849939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3709c93-08ca-4dc0-80db-035f1dfd6760 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:26.860117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3709c93-08ca-4dc0-80db-035f1dfd6760 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:26.866586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae8f83-dab8-4b15-9ae3-2edd0f3d597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:26.867295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8f83-dab8-4b15-9ae3-2edd0f3d597a admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:26.867583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8f83-dab8-4b15-9ae3-2edd0f3d597a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:26.867857 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8f83-dab8-4b15-9ae3-2edd0f3d597a admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:26.868606 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae8f83-dab8-4b15-9ae3-2edd0f3d597a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:26.869268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae8f83-dab8-4b15-9ae3-2edd0f3d597a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:26.870571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae8f83-dab8-4b15-9ae3-2edd0f3d597a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:26.884538 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1265/2524] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:26.891162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cff5e-ff1b-47d1-9bdc-062eba956b67 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:26.904421 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cff5e-ff1b-47d1-9bdc-062eba956b67 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:26.909817 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2fa7e-4c61-4d37-81c0-d7822071d60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:26.910471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2fa7e-4c61-4d37-81c0-d7822071d60c admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:26.910749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2fa7e-4c61-4d37-81c0-d7822071d60c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:26.911020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2fa7e-4c61-4d37-81c0-d7822071d60c admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:26.911708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2fa7e-4c61-4d37-81c0-d7822071d60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:26.913648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2fa7e-4c61-4d37-81c0-d7822071d60c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:26.941270 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1260/2525] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:26 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:26.945696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae8f83-dab8-4b15-9ae3-2edd0f3d597a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:26.956098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae8f83-dab8-4b15-9ae3-2edd0f3d597a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.011615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63674519-3229-4d08-84cf-ff51059d193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.012292 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63674519-3229-4d08-84cf-ff51059d193c admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.012575 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63674519-3229-4d08-84cf-ff51059d193c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.012885 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63674519-3229-4d08-84cf-ff51059d193c admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.013617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63674519-3229-4d08-84cf-ff51059d193c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.015562 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63674519-3229-4d08-84cf-ff51059d193c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.037747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1266/2526] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:26 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:27.042068 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2fa7e-4c61-4d37-81c0-d7822071d60c admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.052559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2fa7e-4c61-4d37-81c0-d7822071d60c admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.057844 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680bf0e-769c-44cd-9542-922c3c8de7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.058632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680bf0e-769c-44cd-9542-922c3c8de7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.058990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680bf0e-769c-44cd-9542-922c3c8de7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.059351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680bf0e-769c-44cd-9542-922c3c8de7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.060255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680bf0e-769c-44cd-9542-922c3c8de7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.062019 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680bf0e-769c-44cd-9542-922c3c8de7ab admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.072845 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1261/2527] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:27.077053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63674519-3229-4d08-84cf-ff51059d193c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.086722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63674519-3229-4d08-84cf-ff51059d193c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.091308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31240e9d-5533-4cdf-9aba-cdaf7bb6e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.091968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31240e9d-5533-4cdf-9aba-cdaf7bb6e7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.092246 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31240e9d-5533-4cdf-9aba-cdaf7bb6e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.092517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31240e9d-5533-4cdf-9aba-cdaf7bb6e7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.093243 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31240e9d-5533-4cdf-9aba-cdaf7bb6e7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.094882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31240e9d-5533-4cdf-9aba-cdaf7bb6e7ec admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.105749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1267/2528] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:27.110089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680bf0e-769c-44cd-9542-922c3c8de7ab admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.120563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680bf0e-769c-44cd-9542-922c3c8de7ab admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.125253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a06578-6d7e-4f1e-88d0-bb8b8c98dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.126263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a06578-6d7e-4f1e-88d0-bb8b8c98dee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.126603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a06578-6d7e-4f1e-88d0-bb8b8c98dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.126942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a06578-6d7e-4f1e-88d0-bb8b8c98dee5 admin admin] PATH_INFO: `/v3/projects/72982ab6df1f4e31bd14b4d4c536fa4b/users/74ac7fe002444edc89dcf8d8f5c88b0f/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.141466 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a06578-6d7e-4f1e-88d0-bb8b8c98dee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72982ab6df1f4e31bd14b4d4c536fa4b, user_id=74ac7fe002444edc89dcf8d8f5c88b0f, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.144185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a06578-6d7e-4f1e-88d0-bb8b8c98dee5 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.157910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1262/2529] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:27 2022] PUT /identity/v3/projects/72982ab6df1f4e31bd14b4d4c536fa4b/users/74ac7fe002444edc89dcf8d8f5c88b0f/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:27.168153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ce4e-d18d-454b-9c09-47dd317c817d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.168434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ce4e-d18d-454b-9c09-47dd317c817d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.168712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ce4e-d18d-454b-9c09-47dd317c817d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.202778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-f967ce4e-d18d-454b-9c09-47dd317c817d None None] MFA Rules not processed for user `74ac7fe002444edc89dcf8d8f5c88b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:27.204327 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-f967ce4e-d18d-454b-9c09-47dd317c817d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:27.270275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1268/2530] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:27.275013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a06578-6d7e-4f1e-88d0-bb8b8c98dee5 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.342353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a06578-6d7e-4f1e-88d0-bb8b8c98dee5 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.347497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d61829-bfb3-46e2-9648-370fddb6dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.348168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d61829-bfb3-46e2-9648-370fddb6dbba admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.348454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d61829-bfb3-46e2-9648-370fddb6dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.348732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d61829-bfb3-46e2-9648-370fddb6dbba admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.349469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d61829-bfb3-46e2-9648-370fddb6dbba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.351388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d61829-bfb3-46e2-9648-370fddb6dbba admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.378986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1263/2531] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:27 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:27.383373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ce4e-d18d-454b-9c09-47dd317c817d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.395587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ce4e-d18d-454b-9c09-47dd317c817d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.452550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780158a0-9892-473d-991f-c8db200c6db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.453344 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780158a0-9892-473d-991f-c8db200c6db0 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.453567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780158a0-9892-473d-991f-c8db200c6db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.453948 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780158a0-9892-473d-991f-c8db200c6db0 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.454709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780158a0-9892-473d-991f-c8db200c6db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.456632 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780158a0-9892-473d-991f-c8db200c6db0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.477526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1269/2532] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:27 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:27.481599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d61829-bfb3-46e2-9648-370fddb6dbba admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.492478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d61829-bfb3-46e2-9648-370fddb6dbba admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.497101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e3206-9f9c-4f52-a8d2-f0b482279d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.497800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e3206-9f9c-4f52-a8d2-f0b482279d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.498089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e3206-9f9c-4f52-a8d2-f0b482279d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.498362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e3206-9f9c-4f52-a8d2-f0b482279d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.499101 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e3206-9f9c-4f52-a8d2-f0b482279d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.500709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e3206-9f9c-4f52-a8d2-f0b482279d97 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.511037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1264/2533] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:27.515480 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780158a0-9892-473d-991f-c8db200c6db0 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.525547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780158a0-9892-473d-991f-c8db200c6db0 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.530512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acab712-9686-462e-b331-572f5f495ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.531450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acab712-9686-462e-b331-572f5f495ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.531741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acab712-9686-462e-b331-572f5f495ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.532040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acab712-9686-462e-b331-572f5f495ed9 admin admin] PATH_INFO: `/v3/projects/50a0d04f87af4594a7af0384f9bd2046/users/07ce1a40968a4a7a9f5d8072ac2bfb93/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.546660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acab712-9686-462e-b331-572f5f495ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a0d04f87af4594a7af0384f9bd2046, user_id=07ce1a40968a4a7a9f5d8072ac2bfb93, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.549407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acab712-9686-462e-b331-572f5f495ed9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.562874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1270/2534] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:27 2022] PUT /identity/v3/projects/50a0d04f87af4594a7af0384f9bd2046/users/07ce1a40968a4a7a9f5d8072ac2bfb93/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:27.567463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e3206-9f9c-4f52-a8d2-f0b482279d97 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.577559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e3206-9f9c-4f52-a8d2-f0b482279d97 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.636364 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7746f-1e35-469c-a2bc-c62d37c3c154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.637034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7746f-1e35-469c-a2bc-c62d37c3c154 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.637319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7746f-1e35-469c-a2bc-c62d37c3c154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.637617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7746f-1e35-469c-a2bc-c62d37c3c154 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.638396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7746f-1e35-469c-a2bc-c62d37c3c154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.640143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7746f-1e35-469c-a2bc-c62d37c3c154 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.652110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1265/2535] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:27.656557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acab712-9686-462e-b331-572f5f495ed9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.668008 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acab712-9686-462e-b331-572f5f495ed9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.673909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4b3c-fd8c-49ec-9dfc-a373da656dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.674806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4b3c-fd8c-49ec-9dfc-a373da656dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.675082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4b3c-fd8c-49ec-9dfc-a373da656dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.675360 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4b3c-fd8c-49ec-9dfc-a373da656dc9 admin admin] PATH_INFO: `/v3/projects/50a0d04f87af4594a7af0384f9bd2046/users/07ce1a40968a4a7a9f5d8072ac2bfb93/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.677564 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b4b3c-fd8c-49ec-9dfc-a373da656dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a0d04f87af4594a7af0384f9bd2046, user_id=07ce1a40968a4a7a9f5d8072ac2bfb93, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.680212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b4b3c-fd8c-49ec-9dfc-a373da656dc9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.691763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1271/2536] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:27 2022] PUT /identity/v3/projects/50a0d04f87af4594a7af0384f9bd2046/users/07ce1a40968a4a7a9f5d8072ac2bfb93/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:27.703196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04b23d-24a7-49fd-9fb0-d22895aad6ce None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.703798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04b23d-24a7-49fd-9fb0-d22895aad6ce None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.704000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04b23d-24a7-49fd-9fb0-d22895aad6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.734891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-8d04b23d-24a7-49fd-9fb0-d22895aad6ce None None] MFA Rules not processed for user `07ce1a40968a4a7a9f5d8072ac2bfb93`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:27.736094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-8d04b23d-24a7-49fd-9fb0-d22895aad6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:27.810379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1266/2537] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:27.821845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4b3c-fd8c-49ec-9dfc-a373da656dc9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:27.823715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ce3b4b3c-fd8c-49ec-9dfc-a373da656dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:27.886686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4b3c-fd8c-49ec-9dfc-a373da656dc9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:27.891762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681c54e-d148-43b1-b3fe-ca2c322def4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:27.892741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681c54e-d148-43b1-b3fe-ca2c322def4f service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:27.893116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681c54e-d148-43b1-b3fe-ca2c322def4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:27.894078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681c54e-d148-43b1-b3fe-ca2c322def4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:27.906848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681c54e-d148-43b1-b3fe-ca2c322def4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:27.908288 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681c54e-d148-43b1-b3fe-ca2c322def4f service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:27.918089 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1272/2538] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:28.496463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04b23d-24a7-49fd-9fb0-d22895aad6ce None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:28.559123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04b23d-24a7-49fd-9fb0-d22895aad6ce None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:28.564620 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:28.565533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:28.565813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:28.566090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] PATH_INFO: `/v3/users/74ac7fe002444edc89dcf8d8f5c88b0f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:28.567399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ac7fe002444edc89dcf8d8f5c88b0f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:28.569323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:28.619595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ac7fe002444edc89dcf8d8f5c88b0f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:28.627106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ac7fe002444edc89dcf8d8f5c88b0f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:28.627766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ac7fe002444edc89dcf8d8f5c88b0f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:28.628372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ac7fe002444edc89dcf8d8f5c88b0f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:28.636876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ac7fe002444edc89dcf8d8f5c88b0f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:28.654045 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1267/2539] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:28 2022] DELETE /identity/v3/users/74ac7fe002444edc89dcf8d8f5c88b0f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:28.658739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc186-4bca-4f3d-8fad-3ea50fc4b1de None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:28.659031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc186-4bca-4f3d-8fad-3ea50fc4b1de None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:28.659308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc186-4bca-4f3d-8fad-3ea50fc4b1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:28.678920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b96dc186-4bca-4f3d-8fad-3ea50fc4b1de None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:28.680112 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b96dc186-4bca-4f3d-8fad-3ea50fc4b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:28.739472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1273/2540] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:28.749623 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:28.751146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:28.809473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465a5fe-ce3f-486a-9bdf-40b74c798621 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:28.816571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e488b6d-fef4-409a-99b1-98fd9f31ded4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:28.817568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e488b6d-fef4-409a-99b1-98fd9f31ded4 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:28.817949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e488b6d-fef4-409a-99b1-98fd9f31ded4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:28.818405 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e488b6d-fef4-409a-99b1-98fd9f31ded4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:28.833479 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e488b6d-fef4-409a-99b1-98fd9f31ded4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:28.834922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e488b6d-fef4-409a-99b1-98fd9f31ded4 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:28.844823 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1268/2541] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:29.120756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc186-4bca-4f3d-8fad-3ea50fc4b1de None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:29.122296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b96dc186-4bca-4f3d-8fad-3ea50fc4b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:29.137083 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc186-4bca-4f3d-8fad-3ea50fc4b1de None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:29.142752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:29.143629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:29.143905 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:29.144144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] PATH_INFO: `/v3/projects/72982ab6df1f4e31bd14b4d4c536fa4b` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:29.145435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72982ab6df1f4e31bd14b4d4c536fa4b)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:29.147408 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:29.195611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72982ab6df1f4e31bd14b4d4c536fa4b', 'request_id': 'req-1c180831-e91d-4672-9966-d231e871c290'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.204078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72982ab6df1f4e31bd14b4d4c536fa4b', 'request_id': 'req-1c180831-e91d-4672-9966-d231e871c290'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.210710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72982ab6df1f4e31bd14b4d4c536fa4b', 'request_id': 'req-1c180831-e91d-4672-9966-d231e871c290'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.220881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] The token cache is being invalidate because project 72982ab6df1f4e31bd14b4d4c536fa4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:29.221167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.221879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.223467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1274/2542] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:29 2022] DELETE /identity/v3/projects/72982ab6df1f4e31bd14b4d4c536fa4b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:29.227531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e488b6d-fef4-409a-99b1-98fd9f31ded4 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:29.237365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e488b6d-fef4-409a-99b1-98fd9f31ded4 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:29.296289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:29.297170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:29.297480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:29.297752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] PATH_INFO: `/v3/users/07ce1a40968a4a7a9f5d8072ac2bfb93` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:29.298971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ce1a40968a4a7a9f5d8072ac2bfb93)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:29.300872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:29.352975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ce1a40968a4a7a9f5d8072ac2bfb93'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.360451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ce1a40968a4a7a9f5d8072ac2bfb93'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.361248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ce1a40968a4a7a9f5d8072ac2bfb93'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.362034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ce1a40968a4a7a9f5d8072ac2bfb93'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.372423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d718fe0-c980-4521-8fba-315d8c83b50d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ce1a40968a4a7a9f5d8072ac2bfb93'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.391287 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1269/2543] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:29 2022] DELETE /identity/v3/users/07ce1a40968a4a7a9f5d8072ac2bfb93 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:29.679597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:29.681131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:29.694834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c180831-e91d-4672-9966-d231e871c290 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:29.750858 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:29.751765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:29.752034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:29.752308 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] PATH_INFO: `/v3/projects/50a0d04f87af4594a7af0384f9bd2046` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:29.753505 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a0d04f87af4594a7af0384f9bd2046)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:29.755405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:29.801889 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a0d04f87af4594a7af0384f9bd2046', 'request_id': 'req-7eca55fd-1904-46bf-b2a4-0a44d7766f63'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.811639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a0d04f87af4594a7af0384f9bd2046', 'request_id': 'req-7eca55fd-1904-46bf-b2a4-0a44d7766f63'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.817782 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a0d04f87af4594a7af0384f9bd2046', 'request_id': 'req-7eca55fd-1904-46bf-b2a4-0a44d7766f63'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.827882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] The token cache is being invalidate because project 50a0d04f87af4594a7af0384f9bd2046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:29.828166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.828855 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-7eca55fd-1904-46bf-b2a4-0a44d7766f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:29.830963 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1275/2544] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:29 2022] DELETE /identity/v3/projects/50a0d04f87af4594a7af0384f9bd2046 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:29.836123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522cf4d-1d15-421d-9afe-9748733a0a55 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:29.836615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522cf4d-1d15-421d-9afe-9748733a0a55 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:29.836733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522cf4d-1d15-421d-9afe-9748733a0a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:29.855518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9522cf4d-1d15-421d-9afe-9748733a0a55 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:29.856811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9522cf4d-1d15-421d-9afe-9748733a0a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:29.918801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1270/2545] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:29.927882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa43acf-0520-4259-9bd3-afa4a1548a61 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:29.928167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa43acf-0520-4259-9bd3-afa4a1548a61 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:29.928455 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa43acf-0520-4259-9bd3-afa4a1548a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:29.947982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-caa43acf-0520-4259-9bd3-afa4a1548a61 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:29.949170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-caa43acf-0520-4259-9bd3-afa4a1548a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:29.957705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1276/2546] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:29.962205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522cf4d-1d15-421d-9afe-9748733a0a55 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:29.972700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522cf4d-1d15-421d-9afe-9748733a0a55 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:29.981199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5911ab-8803-4701-bde0-1cf4d1128142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:29.982261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5911ab-8803-4701-bde0-1cf4d1128142 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:29.982656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5911ab-8803-4701-bde0-1cf4d1128142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:29.983023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5911ab-8803-4701-bde0-1cf4d1128142 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:29.984112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5911ab-8803-4701-bde0-1cf4d1128142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:29.984538 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5911ab-8803-4701-bde0-1cf4d1128142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:29.987086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5911ab-8803-4701-bde0-1cf4d1128142 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.002722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1271/2547] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:30.007222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa43acf-0520-4259-9bd3-afa4a1548a61 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.016500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa43acf-0520-4259-9bd3-afa4a1548a61 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.024933 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca6508-229d-4db2-b39e-f5ee0cda7dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.025861 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca6508-229d-4db2-b39e-f5ee0cda7dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.026154 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca6508-229d-4db2-b39e-f5ee0cda7dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.026429 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca6508-229d-4db2-b39e-f5ee0cda7dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.027497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca6508-229d-4db2-b39e-f5ee0cda7dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.029698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca6508-229d-4db2-b39e-f5ee0cda7dd6 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.058220 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1277/2548] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:30 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:30.062785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5911ab-8803-4701-bde0-1cf4d1128142 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.073100 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5911ab-8803-4701-bde0-1cf4d1128142 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.131166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90760d49-d111-4495-a6a5-d6ba99060635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.131862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760d49-d111-4495-a6a5-d6ba99060635 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.132140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760d49-d111-4495-a6a5-d6ba99060635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.132413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760d49-d111-4495-a6a5-d6ba99060635 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.133106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90760d49-d111-4495-a6a5-d6ba99060635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.135076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90760d49-d111-4495-a6a5-d6ba99060635 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.157106 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1272/2549] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:30 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:30.161394 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca6508-229d-4db2-b39e-f5ee0cda7dd6 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.171896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca6508-229d-4db2-b39e-f5ee0cda7dd6 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.177809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fbcf1-873d-4588-a731-2df25cb8d44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.178472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fbcf1-873d-4588-a731-2df25cb8d44f admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.178753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fbcf1-873d-4588-a731-2df25cb8d44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.179052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fbcf1-873d-4588-a731-2df25cb8d44f admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.179791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fbcf1-873d-4588-a731-2df25cb8d44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.181478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fbcf1-873d-4588-a731-2df25cb8d44f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.192146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1278/2550] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:30.196307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90760d49-d111-4495-a6a5-d6ba99060635 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.206849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90760d49-d111-4495-a6a5-d6ba99060635 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.212696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15852-a665-4807-88e9-cb982440789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.213390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15852-a665-4807-88e9-cb982440789b admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.213669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15852-a665-4807-88e9-cb982440789b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.213933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15852-a665-4807-88e9-cb982440789b admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.214652 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f15852-a665-4807-88e9-cb982440789b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.216256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f15852-a665-4807-88e9-cb982440789b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.226471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1273/2551] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:30.231329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fbcf1-873d-4588-a731-2df25cb8d44f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.242741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fbcf1-873d-4588-a731-2df25cb8d44f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.248820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bf74a-24de-4ef0-91f7-35f24fe46ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.249753 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bf74a-24de-4ef0-91f7-35f24fe46ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.250061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bf74a-24de-4ef0-91f7-35f24fe46ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.250329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bf74a-24de-4ef0-91f7-35f24fe46ffb admin admin] PATH_INFO: `/v3/projects/ec8df79d5de844b99f43bdd10bb6957a/users/ca5427db27d2445898fdca9d0019a48d/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.267080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bf74a-24de-4ef0-91f7-35f24fe46ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8df79d5de844b99f43bdd10bb6957a, user_id=ca5427db27d2445898fdca9d0019a48d, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.269800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bf74a-24de-4ef0-91f7-35f24fe46ffb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.285038 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1279/2552] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:30 2022] PUT /identity/v3/projects/ec8df79d5de844b99f43bdd10bb6957a/users/ca5427db27d2445898fdca9d0019a48d/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:30.296029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260cb1c-fced-4c9c-9f55-4dceebbf9ad5 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.296378 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260cb1c-fced-4c9c-9f55-4dceebbf9ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.296653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260cb1c-fced-4c9c-9f55-4dceebbf9ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.323609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7260cb1c-fced-4c9c-9f55-4dceebbf9ad5 None None] MFA Rules not processed for user `ca5427db27d2445898fdca9d0019a48d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:30.324735 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7260cb1c-fced-4c9c-9f55-4dceebbf9ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:30.399435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1274/2553] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:30.404249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bf74a-24de-4ef0-91f7-35f24fe46ffb admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.470347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bf74a-24de-4ef0-91f7-35f24fe46ffb admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.479275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca26414-f0fd-4c4d-a8a6-9829eb237f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.480183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca26414-f0fd-4c4d-a8a6-9829eb237f5f admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.480532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca26414-f0fd-4c4d-a8a6-9829eb237f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.480918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca26414-f0fd-4c4d-a8a6-9829eb237f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.481901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca26414-f0fd-4c4d-a8a6-9829eb237f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.484599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca26414-f0fd-4c4d-a8a6-9829eb237f5f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.512738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1280/2554] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:30 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:30.517073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260cb1c-fced-4c9c-9f55-4dceebbf9ad5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.528350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260cb1c-fced-4c9c-9f55-4dceebbf9ad5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.585655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb30c74-322f-42a6-9a11-9dc4ba4b8439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.586362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb30c74-322f-42a6-9a11-9dc4ba4b8439 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.586637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb30c74-322f-42a6-9a11-9dc4ba4b8439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.586903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb30c74-322f-42a6-9a11-9dc4ba4b8439 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.587587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb30c74-322f-42a6-9a11-9dc4ba4b8439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.589518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb30c74-322f-42a6-9a11-9dc4ba4b8439 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.611911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1275/2555] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:30 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:30.616404 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca26414-f0fd-4c4d-a8a6-9829eb237f5f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.628062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca26414-f0fd-4c4d-a8a6-9829eb237f5f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.633379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be295e-01b4-4cc5-8e66-182fee20b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.634105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be295e-01b4-4cc5-8e66-182fee20b3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.634389 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be295e-01b4-4cc5-8e66-182fee20b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.634670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be295e-01b4-4cc5-8e66-182fee20b3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.635406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be295e-01b4-4cc5-8e66-182fee20b3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.637016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be295e-01b4-4cc5-8e66-182fee20b3b8 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.648110 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1281/2556] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:30.653172 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb30c74-322f-42a6-9a11-9dc4ba4b8439 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.663604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb30c74-322f-42a6-9a11-9dc4ba4b8439 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.668675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2d32e-bdc9-4a1e-86b3-e7a542904786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.669604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2d32e-bdc9-4a1e-86b3-e7a542904786 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.669886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2d32e-bdc9-4a1e-86b3-e7a542904786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.670243 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2d32e-bdc9-4a1e-86b3-e7a542904786 admin admin] PATH_INFO: `/v3/projects/a09f4c17daf6499a9fdba662e56ef6bc/users/de3fd79645ba4d848b88ef2badab6caf/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.687285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2d32e-bdc9-4a1e-86b3-e7a542904786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09f4c17daf6499a9fdba662e56ef6bc, user_id=de3fd79645ba4d848b88ef2badab6caf, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.690114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2d32e-bdc9-4a1e-86b3-e7a542904786 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.704566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1276/2557] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:30 2022] PUT /identity/v3/projects/a09f4c17daf6499a9fdba662e56ef6bc/users/de3fd79645ba4d848b88ef2badab6caf/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:30.708621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be295e-01b4-4cc5-8e66-182fee20b3b8 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.718509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be295e-01b4-4cc5-8e66-182fee20b3b8 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.775954 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf029751-0d18-48da-b36c-77c0a72452fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.776711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf029751-0d18-48da-b36c-77c0a72452fe admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.777077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf029751-0d18-48da-b36c-77c0a72452fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.777452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf029751-0d18-48da-b36c-77c0a72452fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.778260 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf029751-0d18-48da-b36c-77c0a72452fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.779928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf029751-0d18-48da-b36c-77c0a72452fe admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.790373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1282/2558] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:30.794490 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2d32e-bdc9-4a1e-86b3-e7a542904786 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.805070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2d32e-bdc9-4a1e-86b3-e7a542904786 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:30.809796 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65152705-524c-4065-ae40-205008795ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:30.810692 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65152705-524c-4065-ae40-205008795ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.810972 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65152705-524c-4065-ae40-205008795ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.811241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65152705-524c-4065-ae40-205008795ec2 admin admin] PATH_INFO: `/v3/projects/a09f4c17daf6499a9fdba662e56ef6bc/users/de3fd79645ba4d848b88ef2badab6caf/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.813391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65152705-524c-4065-ae40-205008795ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09f4c17daf6499a9fdba662e56ef6bc, user_id=de3fd79645ba4d848b88ef2badab6caf, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:30.816066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65152705-524c-4065-ae40-205008795ec2 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:30.826142 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1277/2559] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:30 2022] PUT /identity/v3/projects/a09f4c17daf6499a9fdba662e56ef6bc/users/de3fd79645ba4d848b88ef2badab6caf/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:30.837432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0fb09-8924-4e24-8136-e1e305543195 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:30.837648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0fb09-8924-4e24-8136-e1e305543195 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:30.837920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0fb09-8924-4e24-8136-e1e305543195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:30.866346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-fde0fb09-8924-4e24-8136-e1e305543195 None None] MFA Rules not processed for user `de3fd79645ba4d848b88ef2badab6caf`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:30.867631 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fde0fb09-8924-4e24-8136-e1e305543195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:30.935225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1283/2560] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:30.946485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65152705-524c-4065-ae40-205008795ec2 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:30.948267 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-65152705-524c-4065-ae40-205008795ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:31.004791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65152705-524c-4065-ae40-205008795ec2 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:31.008366 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4ab6c-c8d9-4b70-844e-2dc00fa74a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:31.009013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4ab6c-c8d9-4b70-844e-2dc00fa74a34 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:31.009308 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4ab6c-c8d9-4b70-844e-2dc00fa74a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:31.009585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4ab6c-c8d9-4b70-844e-2dc00fa74a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:31.018715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4ab6c-c8d9-4b70-844e-2dc00fa74a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:31.020123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4ab6c-c8d9-4b70-844e-2dc00fa74a34 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:31.030581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1278/2561] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:31.392215 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0fb09-8924-4e24-8136-e1e305543195 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:31.454772 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0fb09-8924-4e24-8136-e1e305543195 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:31.459763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:31.460646 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:31.460927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:31.461203 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] PATH_INFO: `/v3/users/ca5427db27d2445898fdca9d0019a48d` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:31.462440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5427db27d2445898fdca9d0019a48d)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:31.464365 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:31.522634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5427db27d2445898fdca9d0019a48d'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:31.532040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5427db27d2445898fdca9d0019a48d'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:31.533187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5427db27d2445898fdca9d0019a48d'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:31.533848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5427db27d2445898fdca9d0019a48d'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:31.541572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5427db27d2445898fdca9d0019a48d'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:31.558190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1284/2562] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:31 2022] DELETE /identity/v3/users/ca5427db27d2445898fdca9d0019a48d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:31.563054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053a714-f0eb-48ed-b52b-bda957c227ca None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:31.563338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053a714-f0eb-48ed-b52b-bda957c227ca None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:31.563604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053a714-f0eb-48ed-b52b-bda957c227ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:31.581764 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-4053a714-f0eb-48ed-b52b-bda957c227ca None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:31.582967 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4053a714-f0eb-48ed-b52b-bda957c227ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:31.641561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1279/2563] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:31.651824 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:31.653307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:31.711868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58131994-cbc0-4cd4-abb0-d029d2686798 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:31.716075 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b35661-78c1-43f7-8ab4-4f9c760002a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:31.716721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b35661-78c1-43f7-8ab4-4f9c760002a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:31.717001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b35661-78c1-43f7-8ab4-4f9c760002a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:31.717271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b35661-78c1-43f7-8ab4-4f9c760002a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:31.727285 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b35661-78c1-43f7-8ab4-4f9c760002a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:31.728736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b35661-78c1-43f7-8ab4-4f9c760002a3 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:31.738393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1285/2564] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:32.023121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053a714-f0eb-48ed-b52b-bda957c227ca None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:32.024641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4053a714-f0eb-48ed-b52b-bda957c227ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:32.038225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053a714-f0eb-48ed-b52b-bda957c227ca None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:32.043182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:32.045119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:32.045417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:32.045668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] PATH_INFO: `/v3/projects/ec8df79d5de844b99f43bdd10bb6957a` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:32.046974 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8df79d5de844b99f43bdd10bb6957a)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:32.048885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:32.099248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8df79d5de844b99f43bdd10bb6957a', 'request_id': 'req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.105629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8df79d5de844b99f43bdd10bb6957a', 'request_id': 'req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.114803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8df79d5de844b99f43bdd10bb6957a', 'request_id': 'req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.125272 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] The token cache is being invalidate because project ec8df79d5de844b99f43bdd10bb6957a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:32.125595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.126251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.127821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1280/2565] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:32 2022] DELETE /identity/v3/projects/ec8df79d5de844b99f43bdd10bb6957a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:32.132993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b35661-78c1-43f7-8ab4-4f9c760002a3 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:32.144277 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b35661-78c1-43f7-8ab4-4f9c760002a3 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:32.211830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:32.212721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:32.213000 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:32.213276 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] PATH_INFO: `/v3/users/de3fd79645ba4d848b88ef2badab6caf` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:32.214509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3fd79645ba4d848b88ef2badab6caf)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:32.216464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:32.264847 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3fd79645ba4d848b88ef2badab6caf'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.272280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3fd79645ba4d848b88ef2badab6caf'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.272806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3fd79645ba4d848b88ef2badab6caf'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.273661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3fd79645ba4d848b88ef2badab6caf'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.283011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-27b6f318-1ecb-4e79-be0a-7030c18bac26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3fd79645ba4d848b88ef2badab6caf'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.300399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1286/2566] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:32 2022] DELETE /identity/v3/users/de3fd79645ba4d848b88ef2badab6caf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:32.582988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:32.584483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:32.598056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225edeb-01dd-40cf-9caf-8b1b8c6988f2 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:32.654368 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:32.655160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:32.655435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:32.655706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] PATH_INFO: `/v3/projects/a09f4c17daf6499a9fdba662e56ef6bc` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:32.657993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09f4c17daf6499a9fdba662e56ef6bc)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:32.660115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:32.706682 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09f4c17daf6499a9fdba662e56ef6bc', 'request_id': 'req-37234df6-0a37-41f5-87d1-8e6650358cfd'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.712633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09f4c17daf6499a9fdba662e56ef6bc', 'request_id': 'req-37234df6-0a37-41f5-87d1-8e6650358cfd'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.723413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09f4c17daf6499a9fdba662e56ef6bc', 'request_id': 'req-37234df6-0a37-41f5-87d1-8e6650358cfd'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.733839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] The token cache is being invalidate because project a09f4c17daf6499a9fdba662e56ef6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:32.734229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.734866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-37234df6-0a37-41f5-87d1-8e6650358cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:32.736408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1281/2567] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:32 2022] DELETE /identity/v3/projects/a09f4c17daf6499a9fdba662e56ef6bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:32.741805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba7ed-1cd0-430e-83ff-573332255e7b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:32.742314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba7ed-1cd0-430e-83ff-573332255e7b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:32.742483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba7ed-1cd0-430e-83ff-573332255e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:32.760757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a33ba7ed-1cd0-430e-83ff-573332255e7b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:32.761986 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a33ba7ed-1cd0-430e-83ff-573332255e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:32.821683 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1287/2568] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:32.829537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970438c3-e0bd-465a-b87a-5fbf21aad8c9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:32.829828 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970438c3-e0bd-465a-b87a-5fbf21aad8c9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:32.830112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970438c3-e0bd-465a-b87a-5fbf21aad8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:32.848922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-970438c3-e0bd-465a-b87a-5fbf21aad8c9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:32.850174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-970438c3-e0bd-465a-b87a-5fbf21aad8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:32.859251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1282/2569] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:32.863444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba7ed-1cd0-430e-83ff-573332255e7b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:32.873634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba7ed-1cd0-430e-83ff-573332255e7b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:32.879474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119913db-06a2-4ac5-b1b1-367fc0fb8e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:32.880095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119913db-06a2-4ac5-b1b1-367fc0fb8e32 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:32.880371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119913db-06a2-4ac5-b1b1-367fc0fb8e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:32.880637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119913db-06a2-4ac5-b1b1-367fc0fb8e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:32.881403 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119913db-06a2-4ac5-b1b1-367fc0fb8e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:32.881708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119913db-06a2-4ac5-b1b1-367fc0fb8e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:32.883300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119913db-06a2-4ac5-b1b1-367fc0fb8e32 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:32.895329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1288/2570] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:32.899862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970438c3-e0bd-465a-b87a-5fbf21aad8c9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:32.909820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970438c3-e0bd-465a-b87a-5fbf21aad8c9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:32.915283 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce6bf0-6130-478c-8ae2-8a69541e5099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:32.915936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce6bf0-6130-478c-8ae2-8a69541e5099 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:32.916221 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce6bf0-6130-478c-8ae2-8a69541e5099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:32.916482 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce6bf0-6130-478c-8ae2-8a69541e5099 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:32.917161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce6bf0-6130-478c-8ae2-8a69541e5099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:32.919097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce6bf0-6130-478c-8ae2-8a69541e5099 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:32.947805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1283/2571] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:32.951947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119913db-06a2-4ac5-b1b1-367fc0fb8e32 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:32.962118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119913db-06a2-4ac5-b1b1-367fc0fb8e32 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.021997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3843c-6567-4318-a34e-716c8f967bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.022688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3843c-6567-4318-a34e-716c8f967bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.022969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3843c-6567-4318-a34e-716c8f967bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.023240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3843c-6567-4318-a34e-716c8f967bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.023932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3843c-6567-4318-a34e-716c8f967bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.025972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3843c-6567-4318-a34e-716c8f967bc8 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.047186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1289/2572] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:32 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:33.051362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce6bf0-6130-478c-8ae2-8a69541e5099 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.061903 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce6bf0-6130-478c-8ae2-8a69541e5099 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.067557 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f76a-4cdb-49e1-baaf-87c6163df6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.068213 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f76a-4cdb-49e1-baaf-87c6163df6cf admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.068492 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f76a-4cdb-49e1-baaf-87c6163df6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.068752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f76a-4cdb-49e1-baaf-87c6163df6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.069511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f76a-4cdb-49e1-baaf-87c6163df6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.071217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f76a-4cdb-49e1-baaf-87c6163df6cf admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.081723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1284/2573] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:33.085692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3843c-6567-4318-a34e-716c8f967bc8 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.096761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3843c-6567-4318-a34e-716c8f967bc8 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.102934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13712c-8069-4c21-a9e3-4e8427b88af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.103597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13712c-8069-4c21-a9e3-4e8427b88af1 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.103876 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13712c-8069-4c21-a9e3-4e8427b88af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.104173 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13712c-8069-4c21-a9e3-4e8427b88af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.104891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13712c-8069-4c21-a9e3-4e8427b88af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.106533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13712c-8069-4c21-a9e3-4e8427b88af1 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.117264 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1290/2574] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:33.121634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f76a-4cdb-49e1-baaf-87c6163df6cf admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.132321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f76a-4cdb-49e1-baaf-87c6163df6cf admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.137838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b2463-6524-4bfc-93ba-5576ec06978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.138724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b2463-6524-4bfc-93ba-5576ec06978f admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.139008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b2463-6524-4bfc-93ba-5576ec06978f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.139290 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b2463-6524-4bfc-93ba-5576ec06978f admin admin] PATH_INFO: `/v3/projects/d1b4f05a68554008b763b87f92511e3d/users/c50d5f20b83f4adf88a66421d899efa3/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.154420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b2463-6524-4bfc-93ba-5576ec06978f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b4f05a68554008b763b87f92511e3d, user_id=c50d5f20b83f4adf88a66421d899efa3, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.157201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b2463-6524-4bfc-93ba-5576ec06978f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.173841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1285/2575] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:33 2022] PUT /identity/v3/projects/d1b4f05a68554008b763b87f92511e3d/users/c50d5f20b83f4adf88a66421d899efa3/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:33.184191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8acb4-ec4b-40c8-a600-aade3f0aa8df None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.184483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8acb4-ec4b-40c8-a600-aade3f0aa8df None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.184763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8acb4-ec4b-40c8-a600-aade3f0aa8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.210532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-63d8acb4-ec4b-40c8-a600-aade3f0aa8df None None] MFA Rules not processed for user `c50d5f20b83f4adf88a66421d899efa3`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:33.211740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-63d8acb4-ec4b-40c8-a600-aade3f0aa8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:33.278705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1291/2576] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:33.292632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b2463-6524-4bfc-93ba-5576ec06978f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.295349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-630b2463-6524-4bfc-93ba-5576ec06978f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:33.323371 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8acb4-ec4b-40c8-a600-aade3f0aa8df None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.324800 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-63d8acb4-ec4b-40c8-a600-aade3f0aa8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:33.352710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b2463-6524-4bfc-93ba-5576ec06978f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.356819 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4154d1-b932-4386-bad5-16ecef30d4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.357517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4154d1-b932-4386-bad5-16ecef30d4aa service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.357804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4154d1-b932-4386-bad5-16ecef30d4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.358080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4154d1-b932-4386-bad5-16ecef30d4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.367034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4154d1-b932-4386-bad5-16ecef30d4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.368465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4154d1-b932-4386-bad5-16ecef30d4aa service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.377306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1286/2577] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:33.388469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8acb4-ec4b-40c8-a600-aade3f0aa8df None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.393407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.394304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.394583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.394848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] PATH_INFO: `/v3/users/528bf19839fb49d4827f475071aa3718` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.396207 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528bf19839fb49d4827f475071aa3718)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.396474 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4154d1-b932-4386-bad5-16ecef30d4aa service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.398212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.407124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4154d1-b932-4386-bad5-16ecef30d4aa service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.411842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.412721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.412998 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.413271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] PATH_INFO: `/v3/users/c50d5f20b83f4adf88a66421d899efa3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.414506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50d5f20b83f4adf88a66421d899efa3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.416408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.447694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528bf19839fb49d4827f475071aa3718'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.461461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528bf19839fb49d4827f475071aa3718'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.462331 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528bf19839fb49d4827f475071aa3718'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.462955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528bf19839fb49d4827f475071aa3718'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.472197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d78c9c4c-21a9-495e-9f32-a778f15e9899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528bf19839fb49d4827f475071aa3718'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.473083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50d5f20b83f4adf88a66421d899efa3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.479932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50d5f20b83f4adf88a66421d899efa3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.480595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50d5f20b83f4adf88a66421d899efa3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.481187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50d5f20b83f4adf88a66421d899efa3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.490064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ae4fabee-ee45-4129-ae35-3cfa2f525b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50d5f20b83f4adf88a66421d899efa3'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:33.490656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1292/2578] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:33 2022] DELETE /identity/v3/users/528bf19839fb49d4827f475071aa3718 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:33.495273 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130ad4-ff4c-44ec-adce-0fba49675dac None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.495560 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130ad4-ff4c-44ec-adce-0fba49675dac None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.495836 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130ad4-ff4c-44ec-adce-0fba49675dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.510496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1287/2579] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:33 2022] DELETE /identity/v3/users/c50d5f20b83f4adf88a66421d899efa3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:33.512775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-64130ad4-ff4c-44ec-adce-0fba49675dac None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:33.514044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-64130ad4-ff4c-44ec-adce-0fba49675dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:33.514883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501739a-c0b1-4d41-91d6-a6857aa9ed7c None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.515274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501739a-c0b1-4d41-91d6-a6857aa9ed7c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.515560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501739a-c0b1-4d41-91d6-a6857aa9ed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.532285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-7501739a-c0b1-4d41-91d6-a6857aa9ed7c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:33.533502 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7501739a-c0b1-4d41-91d6-a6857aa9ed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:33.571321 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1293/2580] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:33.581314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130ad4-ff4c-44ec-adce-0fba49675dac None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.582792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-64130ad4-ff4c-44ec-adce-0fba49675dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:33.589820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1288/2581] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:33.599598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501739a-c0b1-4d41-91d6-a6857aa9ed7c None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.601781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7501739a-c0b1-4d41-91d6-a6857aa9ed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:33.637682 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130ad4-ff4c-44ec-adce-0fba49675dac None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.641397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dcd32-d5ba-4096-96cb-b60bdd511906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.642049 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dcd32-d5ba-4096-96cb-b60bdd511906 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.642331 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dcd32-d5ba-4096-96cb-b60bdd511906 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.642602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dcd32-d5ba-4096-96cb-b60bdd511906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.651841 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dcd32-d5ba-4096-96cb-b60bdd511906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.653295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dcd32-d5ba-4096-96cb-b60bdd511906 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.657123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501739a-c0b1-4d41-91d6-a6857aa9ed7c None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.660793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013ee7-c3a3-413d-a532-364010ca3bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.661480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013ee7-c3a3-413d-a532-364010ca3bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.661760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013ee7-c3a3-413d-a532-364010ca3bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.662033 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013ee7-c3a3-413d-a532-364010ca3bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.662904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1294/2582] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:33.671667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e013ee7-c3a3-413d-a532-364010ca3bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.673099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e013ee7-c3a3-413d-a532-364010ca3bc6 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.682573 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1289/2583] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:33.927031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dcd32-d5ba-4096-96cb-b60bdd511906 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.928734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ae1dcd32-d5ba-4096-96cb-b60bdd511906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:33.942942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dcd32-d5ba-4096-96cb-b60bdd511906 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.945804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013ee7-c3a3-413d-a532-364010ca3bc6 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:33.947315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-2e013ee7-c3a3-413d-a532-364010ca3bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:33.947949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.948917 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.949137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.949512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] PATH_INFO: `/v3/projects/fc21b1af37d945e992eeadb421cf3314` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.950730 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc21b1af37d945e992eeadb421cf3314)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.952832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:33.966782 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013ee7-c3a3-413d-a532-364010ca3bc6 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:33.971780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:33.972723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:33.973067 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:33.973438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] PATH_INFO: `/v3/projects/d1b4f05a68554008b763b87f92511e3d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:33.974762 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b4f05a68554008b763b87f92511e3d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:33.976880 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.004039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc21b1af37d945e992eeadb421cf3314', 'request_id': 'req-d0fc5def-997d-4f14-9a49-8971d789dee0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.012275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc21b1af37d945e992eeadb421cf3314', 'request_id': 'req-d0fc5def-997d-4f14-9a49-8971d789dee0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.019016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc21b1af37d945e992eeadb421cf3314', 'request_id': 'req-d0fc5def-997d-4f14-9a49-8971d789dee0'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.026029 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b4f05a68554008b763b87f92511e3d', 'request_id': 'req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.029139 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] The token cache is being invalidate because project fc21b1af37d945e992eeadb421cf3314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:34.029463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.030086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-d0fc5def-997d-4f14-9a49-8971d789dee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.031689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1295/2584] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:33 2022] DELETE /identity/v3/projects/fc21b1af37d945e992eeadb421cf3314 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:34.033613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b4f05a68554008b763b87f92511e3d', 'request_id': 'req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.036479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520acb-d121-42b3-a9bd-24e7972d179f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.036761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520acb-d121-42b3-a9bd-24e7972d179f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.037037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520acb-d121-42b3-a9bd-24e7972d179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.043150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b4f05a68554008b763b87f92511e3d', 'request_id': 'req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.053699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] The token cache is being invalidate because project d1b4f05a68554008b763b87f92511e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:34.054335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.054812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0cf617e1-4665-4487-ac61-fb8d6f11cbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:34.055592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c7520acb-d121-42b3-a9bd-24e7972d179f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:34.056526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1290/2585] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:33 2022] DELETE /identity/v3/projects/d1b4f05a68554008b763b87f92511e3d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:34.056842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c7520acb-d121-42b3-a9bd-24e7972d179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:34.061145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b636ad7-1083-47d2-8052-e61809632a36 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.061469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b636ad7-1083-47d2-8052-e61809632a36 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.061753 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b636ad7-1083-47d2-8052-e61809632a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.079349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0b636ad7-1083-47d2-8052-e61809632a36 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:34.080605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0b636ad7-1083-47d2-8052-e61809632a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:34.114332 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1296/2586] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:34.122497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d90e93-f0e5-4a5c-be67-8afbcfa0d684 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.122785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d90e93-f0e5-4a5c-be67-8afbcfa0d684 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.123061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d90e93-f0e5-4a5c-be67-8afbcfa0d684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.137842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1291/2587] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:34.142040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-68d90e93-f0e5-4a5c-be67-8afbcfa0d684 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:34.144051 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-68d90e93-f0e5-4a5c-be67-8afbcfa0d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:34.149313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baedee-348b-43e3-a27a-26d0a264dada None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.149619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baedee-348b-43e3-a27a-26d0a264dada None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.149991 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baedee-348b-43e3-a27a-26d0a264dada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.153594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1297/2588] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:34.157740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d90e93-f0e5-4a5c-be67-8afbcfa0d684 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.166865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d90e93-f0e5-4a5c-be67-8afbcfa0d684 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.168476 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d1baedee-348b-43e3-a27a-26d0a264dada None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:34.169700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d1baedee-348b-43e3-a27a-26d0a264dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:34.172410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e48e5d-7049-4007-a6e8-875df8126131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.173071 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e48e5d-7049-4007-a6e8-875df8126131 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.173388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e48e5d-7049-4007-a6e8-875df8126131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.173674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e48e5d-7049-4007-a6e8-875df8126131 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.174489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e48e5d-7049-4007-a6e8-875df8126131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:34.174799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e48e5d-7049-4007-a6e8-875df8126131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.176448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e48e5d-7049-4007-a6e8-875df8126131 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.177788 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1292/2589] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:34.181885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1baedee-348b-43e3-a27a-26d0a264dada None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.192091 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1298/2590] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:34.192284 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1baedee-348b-43e3-a27a-26d0a264dada None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.193467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e48e5d-7049-4007-a6e8-875df8126131 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.195223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966ba23-b9a6-4b2d-a272-55d2321c5fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.195871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966ba23-b9a6-4b2d-a272-55d2321c5fae admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.196154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966ba23-b9a6-4b2d-a272-55d2321c5fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.196426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966ba23-b9a6-4b2d-a272-55d2321c5fae admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.197149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966ba23-b9a6-4b2d-a272-55d2321c5fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:34.197480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966ba23-b9a6-4b2d-a272-55d2321c5fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.199138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966ba23-b9a6-4b2d-a272-55d2321c5fae admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.203130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e48e5d-7049-4007-a6e8-875df8126131 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.208893 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2415561-232f-4e37-87b0-193101036196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.209558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2415561-232f-4e37-87b0-193101036196 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.209844 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2415561-232f-4e37-87b0-193101036196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.210117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2415561-232f-4e37-87b0-193101036196 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.210618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1293/2591] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:34.210809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2415561-232f-4e37-87b0-193101036196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.212731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2415561-232f-4e37-87b0-193101036196 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.214740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966ba23-b9a6-4b2d-a272-55d2321c5fae admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.223887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966ba23-b9a6-4b2d-a272-55d2321c5fae admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.228648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fe5fc-440b-4164-bbe6-d61e173d60b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.229310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fe5fc-440b-4164-bbe6-d61e173d60b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.229598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fe5fc-440b-4164-bbe6-d61e173d60b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.229856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fe5fc-440b-4164-bbe6-d61e173d60b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.230545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fe5fc-440b-4164-bbe6-d61e173d60b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.232876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fe5fc-440b-4164-bbe6-d61e173d60b3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.241665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1299/2592] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:34.245734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2415561-232f-4e37-87b0-193101036196 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.263351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1294/2593] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:34.264462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fe5fc-440b-4164-bbe6-d61e173d60b3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.306715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2415561-232f-4e37-87b0-193101036196 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.322155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fe5fc-440b-4164-bbe6-d61e173d60b3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.326727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d1d68-533d-47cb-9424-62f41b421b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.327396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d1d68-533d-47cb-9424-62f41b421b3e admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.327738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d1d68-533d-47cb-9424-62f41b421b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.328016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d1d68-533d-47cb-9424-62f41b421b3e admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.328702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d1d68-533d-47cb-9424-62f41b421b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.330653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d1d68-533d-47cb-9424-62f41b421b3e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.353097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1295/2594] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:34.354220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d1d68-533d-47cb-9424-62f41b421b3e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.363323 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb743cd1-5c21-4875-87cc-743ff6b0de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.363478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d1d68-533d-47cb-9424-62f41b421b3e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.364062 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb743cd1-5c21-4875-87cc-743ff6b0de2c admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.364268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb743cd1-5c21-4875-87cc-743ff6b0de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.364559 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb743cd1-5c21-4875-87cc-743ff6b0de2c admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.365690 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb743cd1-5c21-4875-87cc-743ff6b0de2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.367553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb743cd1-5c21-4875-87cc-743ff6b0de2c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.368503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128f26b-ba48-448d-ae54-c37f541b2b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.369144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128f26b-ba48-448d-ae54-c37f541b2b06 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.369463 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128f26b-ba48-448d-ae54-c37f541b2b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.369742 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128f26b-ba48-448d-ae54-c37f541b2b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.370469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128f26b-ba48-448d-ae54-c37f541b2b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.372051 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128f26b-ba48-448d-ae54-c37f541b2b06 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.383759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1296/2595] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:03:34.386136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128f26b-ba48-448d-ae54-c37f541b2b06 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.392676 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1300/2596] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:34.393788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb743cd1-5c21-4875-87cc-743ff6b0de2c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.395549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128f26b-ba48-448d-ae54-c37f541b2b06 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.400494 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db491576-5594-4019-a80e-793aa908cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.401179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db491576-5594-4019-a80e-793aa908cdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.401534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db491576-5594-4019-a80e-793aa908cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.401822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db491576-5594-4019-a80e-793aa908cdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.402582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db491576-5594-4019-a80e-793aa908cdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.403434 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb743cd1-5c21-4875-87cc-743ff6b0de2c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.404190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db491576-5594-4019-a80e-793aa908cdc7 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.408206 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c642e5-8877-4331-9aa0-287a10426109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.408846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c642e5-8877-4331-9aa0-287a10426109 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.409144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c642e5-8877-4331-9aa0-287a10426109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.409443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c642e5-8877-4331-9aa0-287a10426109 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.410163 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c642e5-8877-4331-9aa0-287a10426109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.411733 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c642e5-8877-4331-9aa0-287a10426109 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.417947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1297/2597] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:03:34.419052 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db491576-5594-4019-a80e-793aa908cdc7 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.424602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1301/2598] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:34.425586 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c642e5-8877-4331-9aa0-287a10426109 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.428453 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db491576-5594-4019-a80e-793aa908cdc7 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.433545 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bafa8-7775-4cde-b125-75a2fd8a43b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.434435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bafa8-7775-4cde-b125-75a2fd8a43b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.434718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bafa8-7775-4cde-b125-75a2fd8a43b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.434820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c642e5-8877-4331-9aa0-287a10426109 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.434995 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bafa8-7775-4cde-b125-75a2fd8a43b4 admin admin] PATH_INFO: `/v3/projects/f76129175b874feb8eaa6c2af0ecdc0d/users/0dae296f01e944389589a9df8cb2e585/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.439546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06d897-e480-456a-85d9-0baf2d1d6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.440298 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06d897-e480-456a-85d9-0baf2d1d6b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.440693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06d897-e480-456a-85d9-0baf2d1d6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.441067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06d897-e480-456a-85d9-0baf2d1d6b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.441938 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06d897-e480-456a-85d9-0baf2d1d6b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.443741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06d897-e480-456a-85d9-0baf2d1d6b11 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.449821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bafa8-7775-4cde-b125-75a2fd8a43b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76129175b874feb8eaa6c2af0ecdc0d, user_id=0dae296f01e944389589a9df8cb2e585, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.452598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bafa8-7775-4cde-b125-75a2fd8a43b4 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.455315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1302/2599] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:34.459949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06d897-e480-456a-85d9-0baf2d1d6b11 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.467276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1298/2600] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:34 2022] PUT /identity/v3/projects/f76129175b874feb8eaa6c2af0ecdc0d/users/0dae296f01e944389589a9df8cb2e585/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:34.471702 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06d897-e480-456a-85d9-0baf2d1d6b11 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.477530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0957-0773-41f2-9e8c-9c81251af259 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.477826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0957-0773-41f2-9e8c-9c81251af259 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.478111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0957-0773-41f2-9e8c-9c81251af259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.503899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-cb0d0957-0773-41f2-9e8c-9c81251af259 None None] MFA Rules not processed for user `0dae296f01e944389589a9df8cb2e585`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:34.505091 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cb0d0957-0773-41f2-9e8c-9c81251af259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:34.530912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ffdda-7df5-4939-985b-4a2378ce50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.531813 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ffdda-7df5-4939-985b-4a2378ce50e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.532095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ffdda-7df5-4939-985b-4a2378ce50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.532363 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ffdda-7df5-4939-985b-4a2378ce50e5 admin admin] PATH_INFO: `/v3/projects/b2f9ec9c5b8a4bb28bfb38050eec2f9d/users/a9ed15f559324eb0b58ccb7a8f0bea22/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.546322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ffdda-7df5-4939-985b-4a2378ce50e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f9ec9c5b8a4bb28bfb38050eec2f9d, user_id=a9ed15f559324eb0b58ccb7a8f0bea22, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.548999 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ffdda-7df5-4939-985b-4a2378ce50e5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.563452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1303/2601] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:34 2022] PUT /identity/v3/projects/b2f9ec9c5b8a4bb28bfb38050eec2f9d/users/a9ed15f559324eb0b58ccb7a8f0bea22/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:34.566471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1299/2602] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:34.570898 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ffdda-7df5-4939-985b-4a2378ce50e5 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.574531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58e42f-9cad-4edb-9453-82e67390abf5 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.574820 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58e42f-9cad-4edb-9453-82e67390abf5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.575103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58e42f-9cad-4edb-9453-82e67390abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.601744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3f58e42f-9cad-4edb-9453-82e67390abf5 None None] MFA Rules not processed for user `a9ed15f559324eb0b58ccb7a8f0bea22`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:34.602947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3f58e42f-9cad-4edb-9453-82e67390abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:34.630274 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ffdda-7df5-4939-985b-4a2378ce50e5 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.635183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240915da-dd10-424c-803d-da0046d3ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.635843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240915da-dd10-424c-803d-da0046d3ea18 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.636126 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240915da-dd10-424c-803d-da0046d3ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.636397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240915da-dd10-424c-803d-da0046d3ea18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.637096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240915da-dd10-424c-803d-da0046d3ea18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.639037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240915da-dd10-424c-803d-da0046d3ea18 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.663591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1300/2603] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:34.663791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1304/2604] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:34.668465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58e42f-9cad-4edb-9453-82e67390abf5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.674784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240915da-dd10-424c-803d-da0046d3ea18 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.676654 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-240915da-dd10-424c-803d-da0046d3ea18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:34.678996 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58e42f-9cad-4edb-9453-82e67390abf5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.730804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240915da-dd10-424c-803d-da0046d3ea18 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.731333 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e94ab-8518-4ec2-930a-d896aa4aedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.732016 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e94ab-8518-4ec2-930a-d896aa4aedfc admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.732297 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e94ab-8518-4ec2-930a-d896aa4aedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.732571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e94ab-8518-4ec2-930a-d896aa4aedfc admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.733276 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e94ab-8518-4ec2-930a-d896aa4aedfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.734547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf645f-bd00-455f-ae0d-fc83d8fc40a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.735280 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e94ab-8518-4ec2-930a-d896aa4aedfc admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.735407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf645f-bd00-455f-ae0d-fc83d8fc40a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.735662 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf645f-bd00-455f-ae0d-fc83d8fc40a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.736029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf645f-bd00-455f-ae0d-fc83d8fc40a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.757497 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1301/2605] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:03:34.761435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e94ab-8518-4ec2-930a-d896aa4aedfc admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.770914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e94ab-8518-4ec2-930a-d896aa4aedfc admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.775765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d5ea-9ed2-43e8-bc23-feaadc0e5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.776416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d5ea-9ed2-43e8-bc23-feaadc0e5d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.776703 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d5ea-9ed2-43e8-bc23-feaadc0e5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.776980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d5ea-9ed2-43e8-bc23-feaadc0e5d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.777728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4d5ea-9ed2-43e8-bc23-feaadc0e5d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.779339 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4d5ea-9ed2-43e8-bc23-feaadc0e5d82 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.792767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1302/2606] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:03:34.795157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf645f-bd00-455f-ae0d-fc83d8fc40a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.796932 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf645f-bd00-455f-ae0d-fc83d8fc40a5 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.797075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d5ea-9ed2-43e8-bc23-feaadc0e5d82 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.806136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d5ea-9ed2-43e8-bc23-feaadc0e5d82 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.806929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1305/2607] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:34.812648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab26c4-ec32-4f43-b002-396c4573b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.813589 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab26c4-ec32-4f43-b002-396c4573b265 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.813926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab26c4-ec32-4f43-b002-396c4573b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.814114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab26c4-ec32-4f43-b002-396c4573b265 admin admin] PATH_INFO: `/v3/projects/88d4feb1fb4a44c99bc7f47e9be96710/users/ad5691ab376348e39534833b57104a59/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.829345 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab26c4-ec32-4f43-b002-396c4573b265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d4feb1fb4a44c99bc7f47e9be96710, user_id=ad5691ab376348e39534833b57104a59, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.832042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab26c4-ec32-4f43-b002-396c4573b265 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.845770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1303/2608] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:34 2022] PUT /identity/v3/projects/88d4feb1fb4a44c99bc7f47e9be96710/users/ad5691ab376348e39534833b57104a59/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:34.849567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf645f-bd00-455f-ae0d-fc83d8fc40a5 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.859975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf645f-bd00-455f-ae0d-fc83d8fc40a5 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.919005 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647cc8-49c7-4a5f-8534-b9f686123dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.919644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647cc8-49c7-4a5f-8534-b9f686123dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.919991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647cc8-49c7-4a5f-8534-b9f686123dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.920255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647cc8-49c7-4a5f-8534-b9f686123dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.921065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff647cc8-49c7-4a5f-8534-b9f686123dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.923036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff647cc8-49c7-4a5f-8534-b9f686123dc9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.934360 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1306/2609] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:34.938713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab26c4-ec32-4f43-b002-396c4573b265 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:34.949875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab26c4-ec32-4f43-b002-396c4573b265 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:34.955986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c371629-da54-43fc-9e3e-35b731af231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:34.957204 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c371629-da54-43fc-9e3e-35b731af231d admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.957570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c371629-da54-43fc-9e3e-35b731af231d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.957886 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c371629-da54-43fc-9e3e-35b731af231d admin admin] PATH_INFO: `/v3/projects/88d4feb1fb4a44c99bc7f47e9be96710/users/ad5691ab376348e39534833b57104a59/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:34.960176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c371629-da54-43fc-9e3e-35b731af231d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d4feb1fb4a44c99bc7f47e9be96710, user_id=ad5691ab376348e39534833b57104a59, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:34.963116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c371629-da54-43fc-9e3e-35b731af231d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:34.974163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1304/2610] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:34 2022] PUT /identity/v3/projects/88d4feb1fb4a44c99bc7f47e9be96710/users/ad5691ab376348e39534833b57104a59/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:34.985120 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f88358-fec5-4205-a0eb-f769b08033eb None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:34.985467 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f88358-fec5-4205-a0eb-f769b08033eb None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:34.985934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f88358-fec5-4205-a0eb-f769b08033eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:35.014849 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-f2f88358-fec5-4205-a0eb-f769b08033eb None None] MFA Rules not processed for user `ad5691ab376348e39534833b57104a59`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:35.016250 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-f2f88358-fec5-4205-a0eb-f769b08033eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:35.087027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1307/2611] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:35.100116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c371629-da54-43fc-9e3e-35b731af231d admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:35.168342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c371629-da54-43fc-9e3e-35b731af231d admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:35.174160 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeadcd-17c3-42a2-a39f-dec73f55d783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:35.175105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeadcd-17c3-42a2-a39f-dec73f55d783 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:35.175446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeadcd-17c3-42a2-a39f-dec73f55d783 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:35.175960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeadcd-17c3-42a2-a39f-dec73f55d783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:35.235452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeadcd-17c3-42a2-a39f-dec73f55d783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:35.236793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeadcd-17c3-42a2-a39f-dec73f55d783 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:35.245949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1305/2612] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:39.892113 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f88358-fec5-4205-a0eb-f769b08033eb None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:39.956497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f88358-fec5-4205-a0eb-f769b08033eb None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:39.961754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:39.962617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:39.962909 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:39.963435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] PATH_INFO: `/v3/users/0dae296f01e944389589a9df8cb2e585` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:39.964643 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dae296f01e944389589a9df8cb2e585)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:39.966583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:40.016556 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dae296f01e944389589a9df8cb2e585'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.023151 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dae296f01e944389589a9df8cb2e585'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.023808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dae296f01e944389589a9df8cb2e585'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.024405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dae296f01e944389589a9df8cb2e585'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.033540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dae296f01e944389589a9df8cb2e585'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.051214 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1308/2613] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:39 2022] DELETE /identity/v3/users/0dae296f01e944389589a9df8cb2e585 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:40.056059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7aedd-6ec9-48f9-ab66-432956c8dbfc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:40.056571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7aedd-6ec9-48f9-ab66-432956c8dbfc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:40.056571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7aedd-6ec9-48f9-ab66-432956c8dbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:40.074230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d4b7aedd-6ec9-48f9-ab66-432956c8dbfc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:40.075427 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d4b7aedd-6ec9-48f9-ab66-432956c8dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:40.135890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1306/2614] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:40.147229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:40.148829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:40.212116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eac350-7523-4b67-a0e6-4680fe9ee0b0 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:40.216361 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ef03-df7f-4e80-98f2-c39a31bb4ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:40.217004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ef03-df7f-4e80-98f2-c39a31bb4ced service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:40.217306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ef03-df7f-4e80-98f2-c39a31bb4ced service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:40.217581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ef03-df7f-4e80-98f2-c39a31bb4ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:40.226780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ef03-df7f-4e80-98f2-c39a31bb4ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:40.228200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ef03-df7f-4e80-98f2-c39a31bb4ced service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:40.240067 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1309/2615] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:40.516999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7aedd-6ec9-48f9-ab66-432956c8dbfc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:40.518488 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d4b7aedd-6ec9-48f9-ab66-432956c8dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:40.530420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7aedd-6ec9-48f9-ab66-432956c8dbfc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:40.536302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:40.537569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:40.537856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:40.538130 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] PATH_INFO: `/v3/projects/f76129175b874feb8eaa6c2af0ecdc0d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:40.539356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76129175b874feb8eaa6c2af0ecdc0d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:40.542480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:40.591858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76129175b874feb8eaa6c2af0ecdc0d', 'request_id': 'req-7264acfd-7ece-46cc-b59d-26faf4d49f61'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.598094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76129175b874feb8eaa6c2af0ecdc0d', 'request_id': 'req-7264acfd-7ece-46cc-b59d-26faf4d49f61'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.606772 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76129175b874feb8eaa6c2af0ecdc0d', 'request_id': 'req-7264acfd-7ece-46cc-b59d-26faf4d49f61'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.619839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] The token cache is being invalidate because project f76129175b874feb8eaa6c2af0ecdc0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:40.620235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.621355 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.623876 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1307/2616] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:40 2022] DELETE /identity/v3/projects/f76129175b874feb8eaa6c2af0ecdc0d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:40.627978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ef03-df7f-4e80-98f2-c39a31bb4ced service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:40.637515 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ef03-df7f-4e80-98f2-c39a31bb4ced service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:40.693723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:40.694600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:40.694879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:40.695247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] PATH_INFO: `/v3/users/ad5691ab376348e39534833b57104a59` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:40.696540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5691ab376348e39534833b57104a59)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:40.698486 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:40.744535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5691ab376348e39534833b57104a59'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.750961 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5691ab376348e39534833b57104a59'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.751583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5691ab376348e39534833b57104a59'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.752167 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5691ab376348e39534833b57104a59'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.760074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-00935668-fc0f-4494-8474-2a0164f9b16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5691ab376348e39534833b57104a59'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:40.776868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1310/2617] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:40 2022] DELETE /identity/v3/users/ad5691ab376348e39534833b57104a59 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:41.047237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:41.048712 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:41.061730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264acfd-7ece-46cc-b59d-26faf4d49f61 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:41.117491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:41.118373 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.118654 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.118937 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] PATH_INFO: `/v3/projects/88d4feb1fb4a44c99bc7f47e9be96710` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.120127 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d4feb1fb4a44c99bc7f47e9be96710)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:41.122098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:41.172489 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d4feb1fb4a44c99bc7f47e9be96710', 'request_id': 'req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:41.178575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d4feb1fb4a44c99bc7f47e9be96710', 'request_id': 'req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:41.186617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d4feb1fb4a44c99bc7f47e9be96710', 'request_id': 'req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:41.196592 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] The token cache is being invalidate because project 88d4feb1fb4a44c99bc7f47e9be96710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:41.196875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:41.197500 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-002fce73-cc12-4ae3-b2d3-4b8ba34442a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:41.199020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1308/2618] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:41 2022] DELETE /identity/v3/projects/88d4feb1fb4a44c99bc7f47e9be96710 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:41.203982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5d839-4a2b-4350-8597-8a112d457158 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.204448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5d839-4a2b-4350-8597-8a112d457158 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.204539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5d839-4a2b-4350-8597-8a112d457158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.223320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-0db5d839-4a2b-4350-8597-8a112d457158 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:41.224552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0db5d839-4a2b-4350-8597-8a112d457158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:41.288209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1311/2619] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:41.360060 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715ac8e-ffc4-4845-9ec8-e10f911cb39c None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.360299 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715ac8e-ffc4-4845-9ec8-e10f911cb39c None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.360606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715ac8e-ffc4-4845-9ec8-e10f911cb39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.380341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-9715ac8e-ffc4-4845-9ec8-e10f911cb39c None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:41.381562 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9715ac8e-ffc4-4845-9ec8-e10f911cb39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:41.390454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1309/2620] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:41.395418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5d839-4a2b-4350-8597-8a112d457158 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:41.409451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5d839-4a2b-4350-8597-8a112d457158 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:41.415440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86159f38-c25c-42d9-967c-914a2f31b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:41.416130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86159f38-c25c-42d9-967c-914a2f31b494 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.416435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86159f38-c25c-42d9-967c-914a2f31b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.416672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86159f38-c25c-42d9-967c-914a2f31b494 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.417432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86159f38-c25c-42d9-967c-914a2f31b494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:41.417736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86159f38-c25c-42d9-967c-914a2f31b494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:41.419309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86159f38-c25c-42d9-967c-914a2f31b494 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:41.432555 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1312/2621] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:41.438812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715ac8e-ffc4-4845-9ec8-e10f911cb39c None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:41.448506 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715ac8e-ffc4-4845-9ec8-e10f911cb39c None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:41.454641 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e282603-0f3c-4214-b3e6-123d6c3df462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:41.455294 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e282603-0f3c-4214-b3e6-123d6c3df462 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.455625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e282603-0f3c-4214-b3e6-123d6c3df462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.455901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e282603-0f3c-4214-b3e6-123d6c3df462 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.456597 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e282603-0f3c-4214-b3e6-123d6c3df462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:41.459072 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e282603-0f3c-4214-b3e6-123d6c3df462 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:41.488233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1310/2622] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:41 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:41.493027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86159f38-c25c-42d9-967c-914a2f31b494 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:41.502962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86159f38-c25c-42d9-967c-914a2f31b494 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:41.568707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0163ce-f5f7-4919-9a4a-2949641454e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:41.569608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0163ce-f5f7-4919-9a4a-2949641454e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.569906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0163ce-f5f7-4919-9a4a-2949641454e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.570192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0163ce-f5f7-4919-9a4a-2949641454e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.571236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0163ce-f5f7-4919-9a4a-2949641454e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:41.574101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0163ce-f5f7-4919-9a4a-2949641454e5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:41.597731 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1313/2623] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:41 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:41.602058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e282603-0f3c-4214-b3e6-123d6c3df462 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:41.613023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e282603-0f3c-4214-b3e6-123d6c3df462 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:41.618938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b2700-3c28-4af8-b63c-1da4c3f95e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:41.619591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b2700-3c28-4af8-b63c-1da4c3f95e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.619875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b2700-3c28-4af8-b63c-1da4c3f95e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.620141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b2700-3c28-4af8-b63c-1da4c3f95e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.620938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b2700-3c28-4af8-b63c-1da4c3f95e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:41.622647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b2700-3c28-4af8-b63c-1da4c3f95e97 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:41.636510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1311/2624] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:41.638036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0163ce-f5f7-4919-9a4a-2949641454e5 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:41.648915 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0163ce-f5f7-4919-9a4a-2949641454e5 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:41.654698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef70e60-9b78-4b24-97b1-ad42adac3d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:41.655355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70e60-9b78-4b24-97b1-ad42adac3d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.655633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70e60-9b78-4b24-97b1-ad42adac3d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.655902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70e60-9b78-4b24-97b1-ad42adac3d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.656638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef70e60-9b78-4b24-97b1-ad42adac3d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:41.658249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef70e60-9b78-4b24-97b1-ad42adac3d66 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:41.668470 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1314/2625] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:41.672518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b2700-3c28-4af8-b63c-1da4c3f95e97 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:41.683056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b2700-3c28-4af8-b63c-1da4c3f95e97 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:41.688804 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba162f7-a291-4f94-aadb-e1648a791b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:41.689757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba162f7-a291-4f94-aadb-e1648a791b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.690036 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba162f7-a291-4f94-aadb-e1648a791b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.690306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba162f7-a291-4f94-aadb-e1648a791b7e admin admin] PATH_INFO: `/v3/projects/2f8f54a0a02a48a7a27e4b9474d4787f/users/60a62451b6cc43c9a275a7d7c06bf4fd/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.706760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba162f7-a291-4f94-aadb-e1648a791b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8f54a0a02a48a7a27e4b9474d4787f, user_id=60a62451b6cc43c9a275a7d7c06bf4fd, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:41.709447 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba162f7-a291-4f94-aadb-e1648a791b7e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:41.724587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1312/2626] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:41 2022] PUT /identity/v3/projects/2f8f54a0a02a48a7a27e4b9474d4787f/users/60a62451b6cc43c9a275a7d7c06bf4fd/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:41.729895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2d048-d245-4c08-aaae-9248ff0b180e None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.730188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2d048-d245-4c08-aaae-9248ff0b180e None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.730471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2d048-d245-4c08-aaae-9248ff0b180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.750580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-79e2d048-d245-4c08-aaae-9248ff0b180e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:41.751783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-79e2d048-d245-4c08-aaae-9248ff0b180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:41.816219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1315/2627] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:03:41.830834 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba162f7-a291-4f94-aadb-e1648a791b7e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:41.833551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-aba162f7-a291-4f94-aadb-e1648a791b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:41.898619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba162f7-a291-4f94-aadb-e1648a791b7e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:41.902589 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d252dc-9949-4732-b263-b55f11bc1241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:41.903233 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d252dc-9949-4732-b263-b55f11bc1241 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:41.903471 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d252dc-9949-4732-b263-b55f11bc1241 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:41.903776 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d252dc-9949-4732-b263-b55f11bc1241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:41.913143 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d252dc-9949-4732-b263-b55f11bc1241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:41.914640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d252dc-9949-4732-b263-b55f11bc1241 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:41.924342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1313/2628] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:42.517035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d34b-8c12-4b81-af83-f7caa66dc96a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:42.517601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d34b-8c12-4b81-af83-f7caa66dc96a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:42.517601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d34b-8c12-4b81-af83-f7caa66dc96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:42.543217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-aea7d34b-8c12-4b81-af83-f7caa66dc96a None None] MFA Rules not processed for user `60a62451b6cc43c9a275a7d7c06bf4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:42.544419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-aea7d34b-8c12-4b81-af83-f7caa66dc96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:42.609579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1316/2629] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:42.622039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d252dc-9949-4732-b263-b55f11bc1241 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:42.623980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-84d252dc-9949-4732-b263-b55f11bc1241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:42.688138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d252dc-9949-4732-b263-b55f11bc1241 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:42.695556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58117c63-d3c8-437a-8ad5-81dbd8c88137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:42.696223 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58117c63-d3c8-437a-8ad5-81dbd8c88137 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:42.696501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58117c63-d3c8-437a-8ad5-81dbd8c88137 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:42.696770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58117c63-d3c8-437a-8ad5-81dbd8c88137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:42.706069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58117c63-d3c8-437a-8ad5-81dbd8c88137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:42.707669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58117c63-d3c8-437a-8ad5-81dbd8c88137 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:42.716883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1314/2630] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:44.095621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ea031-9f35-45e4-b229-28a3400069ff None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:44.096124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ea031-9f35-45e4-b229-28a3400069ff None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:44.096320 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ea031-9f35-45e4-b229-28a3400069ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:44.114856 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-786ea031-9f35-45e4-b229-28a3400069ff None None] MFA Rules not processed for user `60a62451b6cc43c9a275a7d7c06bf4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:44.116411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-786ea031-9f35-45e4-b229-28a3400069ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:44.124061 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1317/2631] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:44.357226 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58117c63-d3c8-437a-8ad5-81dbd8c88137 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:44.372147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58117c63-d3c8-437a-8ad5-81dbd8c88137 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:44.379526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c43b26-2eef-4721-99e7-8627cec790b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:44.380639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c43b26-2eef-4721-99e7-8627cec790b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:44.381133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c43b26-2eef-4721-99e7-8627cec790b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:44.381643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c43b26-2eef-4721-99e7-8627cec790b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:44.383774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-11c43b26-2eef-4721-99e7-8627cec790b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:44.395710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c43b26-2eef-4721-99e7-8627cec790b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:44.397138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c43b26-2eef-4721-99e7-8627cec790b8 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:44.405831 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1315/2632] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:52.388881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ea031-9f35-45e4-b229-28a3400069ff None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:52.390406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-786ea031-9f35-45e4-b229-28a3400069ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:52.403940 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ea031-9f35-45e4-b229-28a3400069ff None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:52.408500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:52.409412 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:52.409735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:52.410026 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] PATH_INFO: `/v3/users/a9ed15f559324eb0b58ccb7a8f0bea22` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:52.411218 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ed15f559324eb0b58ccb7a8f0bea22)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:52.413134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:52.462202 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ed15f559324eb0b58ccb7a8f0bea22'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:52.469335 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ed15f559324eb0b58ccb7a8f0bea22'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:52.470191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ed15f559324eb0b58ccb7a8f0bea22'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:52.470692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ed15f559324eb0b58ccb7a8f0bea22'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:52.479907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ed15f559324eb0b58ccb7a8f0bea22'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:52.496928 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1318/2633] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:03:52 2022] DELETE /identity/v3/users/a9ed15f559324eb0b58ccb7a8f0bea22 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:52.501468 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee4bce-e44c-47da-af87-d7c5e06c14f1 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:52.501986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee4bce-e44c-47da-af87-d7c5e06c14f1 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:52.502097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee4bce-e44c-47da-af87-d7c5e06c14f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:52.519353 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-65ee4bce-e44c-47da-af87-d7c5e06c14f1 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:52.521125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-65ee4bce-e44c-47da-af87-d7c5e06c14f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:52.579669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1316/2634] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:52.589765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:52.591277 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:52.651212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcb740-9ed0-49aa-a1c5-ea36132526a0 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:52.655701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c4e6f-d021-4c3a-8aa7-1a86c0dad615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:52.656355 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4e6f-d021-4c3a-8aa7-1a86c0dad615 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:52.656629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4e6f-d021-4c3a-8aa7-1a86c0dad615 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:52.656894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4e6f-d021-4c3a-8aa7-1a86c0dad615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:52.667296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c4e6f-d021-4c3a-8aa7-1a86c0dad615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:52.668779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c4e6f-d021-4c3a-8aa7-1a86c0dad615 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:52.678648 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1319/2635] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:52.998922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee4bce-e44c-47da-af87-d7c5e06c14f1 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.000443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-65ee4bce-e44c-47da-af87-d7c5e06c14f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:53.013586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee4bce-e44c-47da-af87-d7c5e06c14f1 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.019041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.019892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.020174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.020446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] PATH_INFO: `/v3/projects/b2f9ec9c5b8a4bb28bfb38050eec2f9d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.021744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f9ec9c5b8a4bb28bfb38050eec2f9d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.025677 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.072495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f9ec9c5b8a4bb28bfb38050eec2f9d', 'request_id': 'req-8da0e523-cb00-4024-8a83-86002bea2363'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:53.078365 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f9ec9c5b8a4bb28bfb38050eec2f9d', 'request_id': 'req-8da0e523-cb00-4024-8a83-86002bea2363'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:53.086944 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f9ec9c5b8a4bb28bfb38050eec2f9d', 'request_id': 'req-8da0e523-cb00-4024-8a83-86002bea2363'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:53.096757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] The token cache is being invalidate because project b2f9ec9c5b8a4bb28bfb38050eec2f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:03:53.097151 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:53.097800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-8da0e523-cb00-4024-8a83-86002bea2363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:03:53.099349 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1317/2636] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:03:52 2022] DELETE /identity/v3/projects/b2f9ec9c5b8a4bb28bfb38050eec2f9d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:53.104449 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc42f9-3929-4e1d-a420-29c8287535f0 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.104737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc42f9-3929-4e1d-a420-29c8287535f0 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.105011 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc42f9-3929-4e1d-a420-29c8287535f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.123159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-cddc42f9-3929-4e1d-a420-29c8287535f0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:53.124352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cddc42f9-3929-4e1d-a420-29c8287535f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:53.184403 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1320/2637] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:53.192382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018941-ce6e-4930-8a74-19a76e5ce9fa None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.192658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018941-ce6e-4930-8a74-19a76e5ce9fa None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.192940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018941-ce6e-4930-8a74-19a76e5ce9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.212250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-1b018941-ce6e-4930-8a74-19a76e5ce9fa None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:53.213473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1b018941-ce6e-4930-8a74-19a76e5ce9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:53.222547 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1318/2638] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:53.226665 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc42f9-3929-4e1d-a420-29c8287535f0 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.236397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc42f9-3929-4e1d-a420-29c8287535f0 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.242318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017a9a0-35ff-4f83-b4a3-7d3e2a719dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.242965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a9a0-35ff-4f83-b4a3-7d3e2a719dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.243227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a9a0-35ff-4f83-b4a3-7d3e2a719dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.243494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a9a0-35ff-4f83-b4a3-7d3e2a719dd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.244314 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017a9a0-35ff-4f83-b4a3-7d3e2a719dd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:03:53.244611 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017a9a0-35ff-4f83-b4a3-7d3e2a719dd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.246239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017a9a0-35ff-4f83-b4a3-7d3e2a719dd4 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.258211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1321/2639] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:03:53.262610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b018941-ce6e-4930-8a74-19a76e5ce9fa None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.272141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b018941-ce6e-4930-8a74-19a76e5ce9fa None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.277924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7de07-fdd2-4b65-b98b-4293fe989f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.278618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7de07-fdd2-4b65-b98b-4293fe989f49 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.278898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7de07-fdd2-4b65-b98b-4293fe989f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.279156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7de07-fdd2-4b65-b98b-4293fe989f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.279841 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7de07-fdd2-4b65-b98b-4293fe989f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.281744 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7de07-fdd2-4b65-b98b-4293fe989f49 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.309671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1319/2640] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:53 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:53.314049 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017a9a0-35ff-4f83-b4a3-7d3e2a719dd4 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.324226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017a9a0-35ff-4f83-b4a3-7d3e2a719dd4 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.379691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fccfce-c503-41a9-9bbc-330e1da67e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.380400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fccfce-c503-41a9-9bbc-330e1da67e91 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.380686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fccfce-c503-41a9-9bbc-330e1da67e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.380947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fccfce-c503-41a9-9bbc-330e1da67e91 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.381672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fccfce-c503-41a9-9bbc-330e1da67e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.383601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fccfce-c503-41a9-9bbc-330e1da67e91 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.404799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1322/2641] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:53 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:53.408930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7de07-fdd2-4b65-b98b-4293fe989f49 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.419734 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7de07-fdd2-4b65-b98b-4293fe989f49 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.425585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0457a-1242-4c4e-bd72-b78a0f73e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.426253 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0457a-1242-4c4e-bd72-b78a0f73e458 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.426527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0457a-1242-4c4e-bd72-b78a0f73e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.426813 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0457a-1242-4c4e-bd72-b78a0f73e458 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.427542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0457a-1242-4c4e-bd72-b78a0f73e458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.429140 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0457a-1242-4c4e-bd72-b78a0f73e458 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.440154 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1320/2642] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:53.444219 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fccfce-c503-41a9-9bbc-330e1da67e91 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.457168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fccfce-c503-41a9-9bbc-330e1da67e91 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.463990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdf4ab-dfe1-4a3e-b803-c11ca4d9407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.464766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf4ab-dfe1-4a3e-b803-c11ca4d9407b admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.465049 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf4ab-dfe1-4a3e-b803-c11ca4d9407b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.465316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf4ab-dfe1-4a3e-b803-c11ca4d9407b admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.466111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf4ab-dfe1-4a3e-b803-c11ca4d9407b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.467707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf4ab-dfe1-4a3e-b803-c11ca4d9407b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.477993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1323/2643] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:53.482250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0457a-1242-4c4e-bd72-b78a0f73e458 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.492890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0457a-1242-4c4e-bd72-b78a0f73e458 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.497720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f9377-f116-445b-98b7-df7edfe33047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.498607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f9377-f116-445b-98b7-df7edfe33047 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.498884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f9377-f116-445b-98b7-df7edfe33047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.499157 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f9377-f116-445b-98b7-df7edfe33047 admin admin] PATH_INFO: `/v3/projects/ba75a1d673914adbb998fed25c9cc1f1/users/a6a9ada5f1ad435988a1467fbc17e004/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.513596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f9377-f116-445b-98b7-df7edfe33047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba75a1d673914adbb998fed25c9cc1f1, user_id=a6a9ada5f1ad435988a1467fbc17e004, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.516219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f9377-f116-445b-98b7-df7edfe33047 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.531147 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1321/2644] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:53 2022] PUT /identity/v3/projects/ba75a1d673914adbb998fed25c9cc1f1/users/a6a9ada5f1ad435988a1467fbc17e004/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:53.542436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0312e-cbee-4c72-9828-8f7df07e8a51 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.542743 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0312e-cbee-4c72-9828-8f7df07e8a51 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.542983 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0312e-cbee-4c72-9828-8f7df07e8a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.569644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-25b0312e-cbee-4c72-9828-8f7df07e8a51 None None] MFA Rules not processed for user `a6a9ada5f1ad435988a1467fbc17e004`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:53.570546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-25b0312e-cbee-4c72-9828-8f7df07e8a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:53.633356 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1324/2645] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:53.638200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f9377-f116-445b-98b7-df7edfe33047 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.702669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f9377-f116-445b-98b7-df7edfe33047 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.706947 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fbb60-4237-4a0b-9b65-12860bafe9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.707662 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fbb60-4237-4a0b-9b65-12860bafe9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.707943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fbb60-4237-4a0b-9b65-12860bafe9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.708212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fbb60-4237-4a0b-9b65-12860bafe9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.708934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fbb60-4237-4a0b-9b65-12860bafe9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.710869 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fbb60-4237-4a0b-9b65-12860bafe9c9 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.741791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1322/2646] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:53 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:53.746012 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0312e-cbee-4c72-9828-8f7df07e8a51 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.757652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0312e-cbee-4c72-9828-8f7df07e8a51 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.827325 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb667a-e20b-4fc9-850d-80c5c8133d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.828058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb667a-e20b-4fc9-850d-80c5c8133d69 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.828340 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb667a-e20b-4fc9-850d-80c5c8133d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.828618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb667a-e20b-4fc9-850d-80c5c8133d69 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.829337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb667a-e20b-4fc9-850d-80c5c8133d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.831307 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb667a-e20b-4fc9-850d-80c5c8133d69 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.857129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1325/2647] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:53 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:53.858518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fbb60-4237-4a0b-9b65-12860bafe9c9 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.870306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fbb60-4237-4a0b-9b65-12860bafe9c9 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.875524 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627140fe-7a96-4ed2-8b55-ecf9d9a704bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.876307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627140fe-7a96-4ed2-8b55-ecf9d9a704bb admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.876651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627140fe-7a96-4ed2-8b55-ecf9d9a704bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.877150 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627140fe-7a96-4ed2-8b55-ecf9d9a704bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.878015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627140fe-7a96-4ed2-8b55-ecf9d9a704bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.880671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627140fe-7a96-4ed2-8b55-ecf9d9a704bb admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.892759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1323/2648] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:53.896809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb667a-e20b-4fc9-850d-80c5c8133d69 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.907152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb667a-e20b-4fc9-850d-80c5c8133d69 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.913422 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab1f36-e8ae-45c4-a9d4-6d5a08997141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.914203 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1f36-e8ae-45c4-a9d4-6d5a08997141 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.914481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1f36-e8ae-45c4-a9d4-6d5a08997141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.914750 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1f36-e8ae-45c4-a9d4-6d5a08997141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.915476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab1f36-e8ae-45c4-a9d4-6d5a08997141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.917569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab1f36-e8ae-45c4-a9d4-6d5a08997141 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.929068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1326/2649] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:53.933496 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627140fe-7a96-4ed2-8b55-ecf9d9a704bb admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:53.944833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627140fe-7a96-4ed2-8b55-ecf9d9a704bb admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:53.951561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651147ec-69d6-4622-b039-59218adeafcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:53.952613 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651147ec-69d6-4622-b039-59218adeafcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.952899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651147ec-69d6-4622-b039-59218adeafcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.953176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651147ec-69d6-4622-b039-59218adeafcf admin admin] PATH_INFO: `/v3/projects/b6c666f702c2461995a4c5e9dd04e7f0/users/00dba477529c4a598699b36dfb9383f9/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:53.969863 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651147ec-69d6-4622-b039-59218adeafcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c666f702c2461995a4c5e9dd04e7f0, user_id=00dba477529c4a598699b36dfb9383f9, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:53.972833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651147ec-69d6-4622-b039-59218adeafcf admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:53.987426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1324/2650] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:53 2022] PUT /identity/v3/projects/b6c666f702c2461995a4c5e9dd04e7f0/users/00dba477529c4a598699b36dfb9383f9/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:53.998382 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d251ef5-eac8-4fc7-a0a1-6627388ffe4a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:53.998658 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d251ef5-eac8-4fc7-a0a1-6627388ffe4a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:53.998935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d251ef5-eac8-4fc7-a0a1-6627388ffe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.028884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-5d251ef5-eac8-4fc7-a0a1-6627388ffe4a None None] MFA Rules not processed for user `00dba477529c4a598699b36dfb9383f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:54.030176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5d251ef5-eac8-4fc7-a0a1-6627388ffe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:54.101278 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1327/2651] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:54.105699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651147ec-69d6-4622-b039-59218adeafcf admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:54.164993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651147ec-69d6-4622-b039-59218adeafcf admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:54.169989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b6926-b5ad-48ba-8e91-bb0f76da7a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:54.170624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6926-b5ad-48ba-8e91-bb0f76da7a66 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:54.170904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6926-b5ad-48ba-8e91-bb0f76da7a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:54.171183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6926-b5ad-48ba-8e91-bb0f76da7a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.171877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b6926-b5ad-48ba-8e91-bb0f76da7a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:54.173852 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b6926-b5ad-48ba-8e91-bb0f76da7a66 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:54.200788 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1325/2652] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:03:54 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:54.205380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d251ef5-eac8-4fc7-a0a1-6627388ffe4a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:54.215950 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d251ef5-eac8-4fc7-a0a1-6627388ffe4a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:54.277558 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b4a76-bcd8-4341-8d5e-88313d906836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:54.278244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b4a76-bcd8-4341-8d5e-88313d906836 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:54.278523 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b4a76-bcd8-4341-8d5e-88313d906836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:54.278805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b4a76-bcd8-4341-8d5e-88313d906836 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.279500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b4a76-bcd8-4341-8d5e-88313d906836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:54.281500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b4a76-bcd8-4341-8d5e-88313d906836 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:54.303599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1328/2653] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:03:54 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:03:54.307734 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b6926-b5ad-48ba-8e91-bb0f76da7a66 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:54.318619 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b6926-b5ad-48ba-8e91-bb0f76da7a66 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:54.323943 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8bdba-56a4-41c2-932f-5edb6e26a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:54.324793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8bdba-56a4-41c2-932f-5edb6e26a55e admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:54.325671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8bdba-56a4-41c2-932f-5edb6e26a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:54.326197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8bdba-56a4-41c2-932f-5edb6e26a55e admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.327080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8bdba-56a4-41c2-932f-5edb6e26a55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:54.328824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8bdba-56a4-41c2-932f-5edb6e26a55e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:54.342043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1326/2654] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:03:54.346329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b4a76-bcd8-4341-8d5e-88313d906836 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:54.356774 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b4a76-bcd8-4341-8d5e-88313d906836 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:54.361704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a3954-4a23-4f78-ab9d-195caa59a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:54.362916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a3954-4a23-4f78-ab9d-195caa59a9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:54.363296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a3954-4a23-4f78-ab9d-195caa59a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:54.363695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a3954-4a23-4f78-ab9d-195caa59a9d5 admin admin] PATH_INFO: `/v3/projects/3b975c4dda774669b4f7cc2a9daabb9f/users/47ac34b0534b42d0890f373d8d956638/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.380017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a3954-4a23-4f78-ab9d-195caa59a9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b975c4dda774669b4f7cc2a9daabb9f, user_id=47ac34b0534b42d0890f373d8d956638, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:54.383598 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a3954-4a23-4f78-ab9d-195caa59a9d5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:54.400739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1329/2655] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:54 2022] PUT /identity/v3/projects/3b975c4dda774669b4f7cc2a9daabb9f/users/47ac34b0534b42d0890f373d8d956638/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:03:54.405330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8bdba-56a4-41c2-932f-5edb6e26a55e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:54.416777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8bdba-56a4-41c2-932f-5edb6e26a55e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:54.507499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b252218-cf68-43e2-9c7c-f2d3b1a9dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:54.509277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252218-cf68-43e2-9c7c-f2d3b1a9dc65 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:54.510073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252218-cf68-43e2-9c7c-f2d3b1a9dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:54.510629 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252218-cf68-43e2-9c7c-f2d3b1a9dc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.511713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b252218-cf68-43e2-9c7c-f2d3b1a9dc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:54.514469 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b252218-cf68-43e2-9c7c-f2d3b1a9dc65 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:54.521479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a3954-4a23-4f78-ab9d-195caa59a9d5 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:54.524708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b89a3954-4a23-4f78-ab9d-195caa59a9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:54.545201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1327/2656] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:03:54.549438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b252218-cf68-43e2-9c7c-f2d3b1a9dc65 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:54.575171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b252218-cf68-43e2-9c7c-f2d3b1a9dc65 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:54.582749 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6ec9f-46e4-4c62-8526-5bf4819e88dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:54.583686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ec9f-46e4-4c62-8526-5bf4819e88dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:54.584156 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ec9f-46e4-4c62-8526-5bf4819e88dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:54.584596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ec9f-46e4-4c62-8526-5bf4819e88dc admin admin] PATH_INFO: `/v3/projects/3b975c4dda774669b4f7cc2a9daabb9f/users/47ac34b0534b42d0890f373d8d956638/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.587090 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6ec9f-46e4-4c62-8526-5bf4819e88dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b975c4dda774669b4f7cc2a9daabb9f, user_id=47ac34b0534b42d0890f373d8d956638, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:54.595610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6ec9f-46e4-4c62-8526-5bf4819e88dc admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:54.632274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1328/2657] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:03:54 2022] PUT /identity/v3/projects/3b975c4dda774669b4f7cc2a9daabb9f/users/47ac34b0534b42d0890f373d8d956638/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:03:54.636438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277b549-2742-4423-a1f8-0e723f5bfdb9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:54.636812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277b549-2742-4423-a1f8-0e723f5bfdb9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:54.637086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277b549-2742-4423-a1f8-0e723f5bfdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.665124 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a3954-4a23-4f78-ab9d-195caa59a9d5 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:54.666252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-3277b549-2742-4423-a1f8-0e723f5bfdb9 None None] MFA Rules not processed for user `47ac34b0534b42d0890f373d8d956638`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:03:54.668363 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3277b549-2742-4423-a1f8-0e723f5bfdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:54.757131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:54.758375 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:54.758780 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1329/2658] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:03:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:03:54.761681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:54.762160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.767044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:54.771717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277b549-2742-4423-a1f8-0e723f5bfdb9 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:54.774257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3277b549-2742-4423-a1f8-0e723f5bfdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:54.829482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:54.831115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:54.842097 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1330/2659] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:03:54.851965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277b549-2742-4423-a1f8-0e723f5bfdb9 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:54.857606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac326a-9bec-4bf7-8e76-d4a5e97e85ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:54.859228 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac326a-9bec-4bf7-8e76-d4a5e97e85ac service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:54.859610 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac326a-9bec-4bf7-8e76-d4a5e97e85ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:54.860139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac326a-9bec-4bf7-8e76-d4a5e97e85ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:54.921212 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac326a-9bec-4bf7-8e76-d4a5e97e85ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:54.922688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac326a-9bec-4bf7-8e76-d4a5e97e85ac service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:54.933021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1330/2660] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:56.503469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:56.506059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:56.524286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bd80-c556-4bc7-b068-fa5673ed451d service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:56.532548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f149-8668-4188-a156-8bbc73f15e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:56.533236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f149-8668-4188-a156-8bbc73f15e11 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:56.533722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f149-8668-4188-a156-8bbc73f15e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:56.534197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f149-8668-4188-a156-8bbc73f15e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:56.614540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463f149-8668-4188-a156-8bbc73f15e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:56.616934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463f149-8668-4188-a156-8bbc73f15e11 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:56.631854 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1331/2661] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:57.170296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac326a-9bec-4bf7-8e76-d4a5e97e85ac service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:57.179625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac326a-9bec-4bf7-8e76-d4a5e97e85ac service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:57.184170 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439394b-53c0-4ccf-9f79-f7d1c73ed733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:57.184818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439394b-53c0-4ccf-9f79-f7d1c73ed733 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:57.185099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439394b-53c0-4ccf-9f79-f7d1c73ed733 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:57.185388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439394b-53c0-4ccf-9f79-f7d1c73ed733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:57.195811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439394b-53c0-4ccf-9f79-f7d1c73ed733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:57.197235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439394b-53c0-4ccf-9f79-f7d1c73ed733 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:57.207408 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1331/2662] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:03:59.303028 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f149-8668-4188-a156-8bbc73f15e11 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:03:59.304532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-7463f149-8668-4188-a156-8bbc73f15e11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:59.369491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f149-8668-4188-a156-8bbc73f15e11 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:03:59.373172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894d366-9d9b-47a7-b5de-5147fdf8a461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:03:59.373862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d366-9d9b-47a7-b5de-5147fdf8a461 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:03:59.374144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d366-9d9b-47a7-b5de-5147fdf8a461 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:03:59.374423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d366-9d9b-47a7-b5de-5147fdf8a461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:03:59.376201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e894d366-9d9b-47a7-b5de-5147fdf8a461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:03:59.443016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894d366-9d9b-47a7-b5de-5147fdf8a461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:03:59.444466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894d366-9d9b-47a7-b5de-5147fdf8a461 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:03:59.454504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1332/2663] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:01.104889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439394b-53c0-4ccf-9f79-f7d1c73ed733 service cinder] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:01.120053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439394b-53c0-4ccf-9f79-f7d1c73ed733 service cinder] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:01.125862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:01.127083 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:01.127608 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:01.128168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] PATH_INFO: `/v3/users/a6a9ada5f1ad435988a1467fbc17e004` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:01.129700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a9ada5f1ad435988a1467fbc17e004)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:01.132013 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:01.193023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a9ada5f1ad435988a1467fbc17e004'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:01.201722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a9ada5f1ad435988a1467fbc17e004'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:01.202955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a9ada5f1ad435988a1467fbc17e004'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:01.203811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a9ada5f1ad435988a1467fbc17e004'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:01.214302 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a9ada5f1ad435988a1467fbc17e004'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:01.243288 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1332/2664] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:01 2022] DELETE /identity/v3/users/a6a9ada5f1ad435988a1467fbc17e004 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:01.247790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1780-b35c-46af-8dd7-7fa45ddf5e0b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:01.248353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1780-b35c-46af-8dd7-7fa45ddf5e0b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:01.248353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1780-b35c-46af-8dd7-7fa45ddf5e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:01.266774 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6d7d1780-b35c-46af-8dd7-7fa45ddf5e0b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:01.268186 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6d7d1780-b35c-46af-8dd7-7fa45ddf5e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:01.332468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1333/2665] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:01.346493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:01.348416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:01.421761 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28cfff-bd63-4748-9651-934bdf6ce69b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:01.425805 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b3e17-fd7a-43c8-96e4-f4fd887bd0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:01.426483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b3e17-fd7a-43c8-96e4-f4fd887bd0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:01.426768 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b3e17-fd7a-43c8-96e4-f4fd887bd0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:01.427706 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b3e17-fd7a-43c8-96e4-f4fd887bd0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:01.438714 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b3e17-fd7a-43c8-96e4-f4fd887bd0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:01.441173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b3e17-fd7a-43c8-96e4-f4fd887bd0f2 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:01.468211 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1333/2666] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:01.912696 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1780-b35c-46af-8dd7-7fa45ddf5e0b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:01.914438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6d7d1780-b35c-46af-8dd7-7fa45ddf5e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:01.931943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1780-b35c-46af-8dd7-7fa45ddf5e0b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:01.942802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:01.943726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:01.944694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:01.944998 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] PATH_INFO: `/v3/projects/ba75a1d673914adbb998fed25c9cc1f1` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:01.946561 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba75a1d673914adbb998fed25c9cc1f1)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:01.948840 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:01.998976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba75a1d673914adbb998fed25c9cc1f1', 'request_id': 'req-ef0a0062-97ac-4a46-a1a6-a1143e343614'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.008953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba75a1d673914adbb998fed25c9cc1f1', 'request_id': 'req-ef0a0062-97ac-4a46-a1a6-a1143e343614'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.015837 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba75a1d673914adbb998fed25c9cc1f1', 'request_id': 'req-ef0a0062-97ac-4a46-a1a6-a1143e343614'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.026490 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] The token cache is being invalidate because project ba75a1d673914adbb998fed25c9cc1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:02.026902 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.027639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.029914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1334/2667] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:01 2022] DELETE /identity/v3/projects/ba75a1d673914adbb998fed25c9cc1f1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:02.036335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b3e17-fd7a-43c8-96e4-f4fd887bd0f2 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:02.046885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b3e17-fd7a-43c8-96e4-f4fd887bd0f2 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:02.107342 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:02.108322 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:02.108648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:02.108936 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] PATH_INFO: `/v3/users/00dba477529c4a598699b36dfb9383f9` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:02.110225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00dba477529c4a598699b36dfb9383f9)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:02.112588 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:02.158633 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00dba477529c4a598699b36dfb9383f9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.165031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00dba477529c4a598699b36dfb9383f9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.165739 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00dba477529c4a598699b36dfb9383f9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.166327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00dba477529c4a598699b36dfb9383f9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.177964 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00dba477529c4a598699b36dfb9383f9'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.197693 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1334/2668] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:02 2022] DELETE /identity/v3/users/00dba477529c4a598699b36dfb9383f9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:02.608509 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:02.610529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:02.631123 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a0062-97ac-4a46-a1a6-a1143e343614 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:02.710183 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:02.721898 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:02.722453 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:02.723147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] PATH_INFO: `/v3/projects/b6c666f702c2461995a4c5e9dd04e7f0` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:02.726398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c666f702c2461995a4c5e9dd04e7f0)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:02.729626 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:02.792469 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c666f702c2461995a4c5e9dd04e7f0', 'request_id': 'req-e3160383-fa08-411c-9083-9c10e740816c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.801697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c666f702c2461995a4c5e9dd04e7f0', 'request_id': 'req-e3160383-fa08-411c-9083-9c10e740816c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.809159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c666f702c2461995a4c5e9dd04e7f0', 'request_id': 'req-e3160383-fa08-411c-9083-9c10e740816c'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.820785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] The token cache is being invalidate because project b6c666f702c2461995a4c5e9dd04e7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:02.821073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.821762 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.823334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1335/2669] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:02 2022] DELETE /identity/v3/projects/b6c666f702c2461995a4c5e9dd04e7f0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:02.830765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:02.832810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:02.848955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fa566-8292-49ad-9e05-99f01cfbe534 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:02.909235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:02.910705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:02.910705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:02.910931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] PATH_INFO: `/v3/users/47ac34b0534b42d0890f373d8d956638` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:02.912075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ac34b0534b42d0890f373d8d956638)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:02.914120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:02.967581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ac34b0534b42d0890f373d8d956638'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.982167 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ac34b0534b42d0890f373d8d956638'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.983686 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ac34b0534b42d0890f373d8d956638'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.984752 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ac34b0534b42d0890f373d8d956638'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:02.992857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-5d9a23a7-6be8-45bc-99af-2eb19cd583f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ac34b0534b42d0890f373d8d956638'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:03.024239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1335/2670] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:02 2022] DELETE /identity/v3/users/47ac34b0534b42d0890f373d8d956638 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:03.436076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:03.438368 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:03.474695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3160383-fa08-411c-9083-9c10e740816c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:03.557924 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:03.560703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:03.561144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:03.561407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] PATH_INFO: `/v3/projects/3b975c4dda774669b4f7cc2a9daabb9f` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:03.562790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b975c4dda774669b4f7cc2a9daabb9f)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:03.564786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:03.624388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b975c4dda774669b4f7cc2a9daabb9f', 'request_id': 'req-fa4e45f0-07ec-4197-89a0-3677b5a957ef'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:03.632001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b975c4dda774669b4f7cc2a9daabb9f', 'request_id': 'req-fa4e45f0-07ec-4197-89a0-3677b5a957ef'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:03.638452 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b975c4dda774669b4f7cc2a9daabb9f', 'request_id': 'req-fa4e45f0-07ec-4197-89a0-3677b5a957ef'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:03.648834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] The token cache is being invalidate because project 3b975c4dda774669b4f7cc2a9daabb9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:03.648834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:03.651313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fa4e45f0-07ec-4197-89a0-3677b5a957ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:03.651313 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1336/2671] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:03 2022] DELETE /identity/v3/projects/3b975c4dda774669b4f7cc2a9daabb9f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:04:03.656598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d70a8-e976-434c-9cec-abaf5cad9e5a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:03.657102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d70a8-e976-434c-9cec-abaf5cad9e5a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:03.657207 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d70a8-e976-434c-9cec-abaf5cad9e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:03.679027 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d03d70a8-e976-434c-9cec-abaf5cad9e5a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:03.680451 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d03d70a8-e976-434c-9cec-abaf5cad9e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:03.745939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1336/2672] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:04:03.755021 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dccf8-e20b-405e-b949-25e06f9a9d11 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:03.755757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dccf8-e20b-405e-b949-25e06f9a9d11 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:03.756130 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dccf8-e20b-405e-b949-25e06f9a9d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:03.778779 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6a5dccf8-e20b-405e-b949-25e06f9a9d11 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:03.780261 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6a5dccf8-e20b-405e-b949-25e06f9a9d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:03.796017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1337/2673] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:03.800465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d70a8-e976-434c-9cec-abaf5cad9e5a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:03.811278 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d70a8-e976-434c-9cec-abaf5cad9e5a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:03.816251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f44e-d3c2-46eb-aa16-5500a2bc982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:03.819093 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f44e-d3c2-46eb-aa16-5500a2bc982d admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:03.819599 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f44e-d3c2-46eb-aa16-5500a2bc982d admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:03.820094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f44e-d3c2-46eb-aa16-5500a2bc982d admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:03.821945 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f44e-d3c2-46eb-aa16-5500a2bc982d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:04:03.822262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f44e-d3c2-46eb-aa16-5500a2bc982d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:03.823900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f44e-d3c2-46eb-aa16-5500a2bc982d admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:03.844187 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1337/2674] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:04:03.848862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dccf8-e20b-405e-b949-25e06f9a9d11 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:03.858479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dccf8-e20b-405e-b949-25e06f9a9d11 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:03.863817 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2d71-ff07-4758-a22d-df892cf2becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:03.864661 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2d71-ff07-4758-a22d-df892cf2becc admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:03.865128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2d71-ff07-4758-a22d-df892cf2becc admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:03.865600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2d71-ff07-4758-a22d-df892cf2becc admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:03.866309 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d2d71-ff07-4758-a22d-df892cf2becc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:03.868232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d2d71-ff07-4758-a22d-df892cf2becc admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:03.913326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f44e-d3c2-46eb-aa16-5500a2bc982d admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:03.917492 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1338/2675] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:04:03 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:04:03.924798 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f44e-d3c2-46eb-aa16-5500a2bc982d admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:03.988648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54416aa1-31b0-4726-be2f-22f63773e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:03.990745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54416aa1-31b0-4726-be2f-22f63773e064 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:03.990745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54416aa1-31b0-4726-be2f-22f63773e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:03.990745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54416aa1-31b0-4726-be2f-22f63773e064 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:03.991218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54416aa1-31b0-4726-be2f-22f63773e064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:03.993163 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54416aa1-31b0-4726-be2f-22f63773e064 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:04.035109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1338/2676] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:04:03 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:04.038583 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2d71-ff07-4758-a22d-df892cf2becc admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:04.061826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2d71-ff07-4758-a22d-df892cf2becc admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:04.069405 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e05830-42f3-4515-809d-4d45b2211628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:04.070272 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e05830-42f3-4515-809d-4d45b2211628 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:04.070717 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e05830-42f3-4515-809d-4d45b2211628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:04.071153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e05830-42f3-4515-809d-4d45b2211628 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:04.072506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e05830-42f3-4515-809d-4d45b2211628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:04.074927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e05830-42f3-4515-809d-4d45b2211628 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:04.094328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1339/2677] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:04.102549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54416aa1-31b0-4726-be2f-22f63773e064 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:04.117882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54416aa1-31b0-4726-be2f-22f63773e064 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:04.124376 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f4392-466d-44b7-9316-6af0de1e3d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:04.125815 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f4392-466d-44b7-9316-6af0de1e3d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:04.126670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f4392-466d-44b7-9316-6af0de1e3d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:04.126990 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f4392-466d-44b7-9316-6af0de1e3d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:04.132883 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f4392-466d-44b7-9316-6af0de1e3d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:04.135263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f4392-466d-44b7-9316-6af0de1e3d88 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:04.148075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1339/2678] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:04.152508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e05830-42f3-4515-809d-4d45b2211628 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:04.170819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e05830-42f3-4515-809d-4d45b2211628 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:04.180414 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73f743-8374-4167-a497-90eff30309b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:04.181726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73f743-8374-4167-a497-90eff30309b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:04.182176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73f743-8374-4167-a497-90eff30309b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:04.182615 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73f743-8374-4167-a497-90eff30309b4 admin admin] PATH_INFO: `/v3/projects/d8ff272c8b0c4e79be087bec9a4f7286/users/b39e429a52c44d7ba736f605ea250717/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:04.208305 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73f743-8374-4167-a497-90eff30309b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ff272c8b0c4e79be087bec9a4f7286, user_id=b39e429a52c44d7ba736f605ea250717, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:04.211474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73f743-8374-4167-a497-90eff30309b4 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:04.231589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1340/2679] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:04 2022] PUT /identity/v3/projects/d8ff272c8b0c4e79be087bec9a4f7286/users/b39e429a52c44d7ba736f605ea250717/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:04.242347 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568d13b-6447-4fa9-9371-60f0aefae691 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:04.243097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568d13b-6447-4fa9-9371-60f0aefae691 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:04.243600 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568d13b-6447-4fa9-9371-60f0aefae691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:04.292765 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-e568d13b-6447-4fa9-9371-60f0aefae691 None None] MFA Rules not processed for user `b39e429a52c44d7ba736f605ea250717`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:04.294891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e568d13b-6447-4fa9-9371-60f0aefae691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:04.389814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1340/2680] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:04.398117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73f743-8374-4167-a497-90eff30309b4 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:04.400605 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-aa73f743-8374-4167-a497-90eff30309b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:04.469867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73f743-8374-4167-a497-90eff30309b4 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:04.473566 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c51d86-637f-434a-95f6-2036addf2c47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63b338ae7e374ba5a7542c5a53deb416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:04.474221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c51d86-637f-434a-95f6-2036addf2c47 service glance] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:04.474498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c51d86-637f-434a-95f6-2036addf2c47 service glance] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:04.474775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c51d86-637f-434a-95f6-2036addf2c47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:04.483239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c51d86-637f-434a-95f6-2036addf2c47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:04.484699 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c51d86-637f-434a-95f6-2036addf2c47 service glance] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:04.495159 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1341/2681] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:07.685165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568d13b-6447-4fa9-9371-60f0aefae691 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:07.686862 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e568d13b-6447-4fa9-9371-60f0aefae691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:07.762955 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568d13b-6447-4fa9-9371-60f0aefae691 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:07.767678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:07.768802 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:07.769084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:07.769387 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] PATH_INFO: `/v3/users/8d4c2574bb2844d5ab718dff3cf275e0` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:07.770616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4c2574bb2844d5ab718dff3cf275e0)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:07.772878 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:07.837836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4c2574bb2844d5ab718dff3cf275e0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:07.846208 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4c2574bb2844d5ab718dff3cf275e0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:07.846934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4c2574bb2844d5ab718dff3cf275e0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:07.847522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4c2574bb2844d5ab718dff3cf275e0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:07.856116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4c2574bb2844d5ab718dff3cf275e0'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:07.872994 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1341/2682] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:07 2022] DELETE /identity/v3/users/8d4c2574bb2844d5ab718dff3cf275e0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:08.054758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c51d86-637f-434a-95f6-2036addf2c47 service glance] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:08.065667 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c51d86-637f-434a-95f6-2036addf2c47 service glance] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:08.129949 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:08.130834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:08.131118 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:08.131398 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] PATH_INFO: `/v3/projects/8bf2894c75244d3f8e2c83c7deb9ab3e` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:08.132585 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf2894c75244d3f8e2c83c7deb9ab3e)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:08.134529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:08.185230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf2894c75244d3f8e2c83c7deb9ab3e', 'request_id': 'req-f86652ad-71d3-45ab-9e1b-8296bd225ef2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.195191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf2894c75244d3f8e2c83c7deb9ab3e', 'request_id': 'req-f86652ad-71d3-45ab-9e1b-8296bd225ef2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.202370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf2894c75244d3f8e2c83c7deb9ab3e', 'request_id': 'req-f86652ad-71d3-45ab-9e1b-8296bd225ef2'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.213689 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] The token cache is being invalidate because project 8bf2894c75244d3f8e2c83c7deb9ab3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:08.214315 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.214701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.216502 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1342/2683] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:08 2022] DELETE /identity/v3/projects/8bf2894c75244d3f8e2c83c7deb9ab3e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:08.220328 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:08.222843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:08.238615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf8378-f366-439b-a4cb-dc0f7f71d3df admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:08.304286 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:08.305133 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:08.305456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:08.305770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] PATH_INFO: `/v3/users/5a9c89238e5b41c29fe9c24318a53b64` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:08.308741 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9c89238e5b41c29fe9c24318a53b64)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:08.309139 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:08.368968 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9c89238e5b41c29fe9c24318a53b64'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.376260 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9c89238e5b41c29fe9c24318a53b64'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.377039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9c89238e5b41c29fe9c24318a53b64'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.377681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9c89238e5b41c29fe9c24318a53b64'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.387118 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9c89238e5b41c29fe9c24318a53b64'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.405098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1342/2684] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:08 2022] DELETE /identity/v3/users/5a9c89238e5b41c29fe9c24318a53b64 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:08.548204 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:08.549982 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:08.585417 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:08.587039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:08.619437 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86652ad-71d3-45ab-9e1b-8296bd225ef2 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:08.654931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115140-427b-4cbb-b021-2ed6538c2e99 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:08.659772 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:08.660669 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:08.660952 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:08.661229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] PATH_INFO: `/v3/projects/35ee653d6d2a4669b9161bbdf73b726c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:08.662456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ee653d6d2a4669b9161bbdf73b726c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:08.664384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:08.669808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe0742-b760-449a-aba9-356ed2a1fe18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:08.670535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe0742-b760-449a-aba9-356ed2a1fe18 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:08.670894 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe0742-b760-449a-aba9-356ed2a1fe18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:08.671230 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe0742-b760-449a-aba9-356ed2a1fe18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:08.673141 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-71fe0742-b760-449a-aba9-356ed2a1fe18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:08.685033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe0742-b760-449a-aba9-356ed2a1fe18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:08.686494 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe0742-b760-449a-aba9-356ed2a1fe18 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:08.697617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1343/2685] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:08.711399 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ee653d6d2a4669b9161bbdf73b726c', 'request_id': 'req-68167270-9f05-48c6-bf88-79d608d98a3b'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.717859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ee653d6d2a4669b9161bbdf73b726c', 'request_id': 'req-68167270-9f05-48c6-bf88-79d608d98a3b'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.726085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ee653d6d2a4669b9161bbdf73b726c', 'request_id': 'req-68167270-9f05-48c6-bf88-79d608d98a3b'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.736989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] The token cache is being invalidate because project 35ee653d6d2a4669b9161bbdf73b726c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:08.737616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.741534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-68167270-9f05-48c6-bf88-79d608d98a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:08.743241 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1343/2686] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:08 2022] DELETE /identity/v3/projects/35ee653d6d2a4669b9161bbdf73b726c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:04:08.748099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d699-d50c-451f-bdf5-5d9a78ec472d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:08.748390 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d699-d50c-451f-bdf5-5d9a78ec472d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:08.748667 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d699-d50c-451f-bdf5-5d9a78ec472d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:08.766778 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-21f7d699-d50c-451f-bdf5-5d9a78ec472d None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:08.768048 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-21f7d699-d50c-451f-bdf5-5d9a78ec472d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:08.827553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1344/2687] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:04:08.835414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e7c2c-0f92-4e08-97a9-db13ce047dd5 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:08.835634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e7c2c-0f92-4e08-97a9-db13ce047dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:08.835905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e7c2c-0f92-4e08-97a9-db13ce047dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:08.858250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-353e7c2c-0f92-4e08-97a9-db13ce047dd5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:08.860860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-353e7c2c-0f92-4e08-97a9-db13ce047dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:08.873057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1344/2688] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:08.873895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d699-d50c-451f-bdf5-5d9a78ec472d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:08.884761 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d699-d50c-451f-bdf5-5d9a78ec472d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:08.889547 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd980bd-764b-4576-8e1d-9cb76de7d67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:08.890316 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd980bd-764b-4576-8e1d-9cb76de7d67a admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:08.890741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd980bd-764b-4576-8e1d-9cb76de7d67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:08.891143 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd980bd-764b-4576-8e1d-9cb76de7d67a admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:08.892088 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd980bd-764b-4576-8e1d-9cb76de7d67a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:04:08.892489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd980bd-764b-4576-8e1d-9cb76de7d67a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:08.894285 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd980bd-764b-4576-8e1d-9cb76de7d67a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:08.910160 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1345/2689] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:04:08.911933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e7c2c-0f92-4e08-97a9-db13ce047dd5 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:08.920882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e7c2c-0f92-4e08-97a9-db13ce047dd5 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:08.925513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc131fd-bfea-48ec-8a10-cc1049820a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:08.926199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc131fd-bfea-48ec-8a10-cc1049820a99 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:08.926475 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc131fd-bfea-48ec-8a10-cc1049820a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:08.926748 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc131fd-bfea-48ec-8a10-cc1049820a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:08.927446 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc131fd-bfea-48ec-8a10-cc1049820a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:08.929375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc131fd-bfea-48ec-8a10-cc1049820a99 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:08.959842 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1345/2690] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:04:08 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:08.963774 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd980bd-764b-4576-8e1d-9cb76de7d67a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:08.981317 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd980bd-764b-4576-8e1d-9cb76de7d67a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:09.044446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0571-47f4-4ac2-8b00-c2094ae08e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:09.045384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0571-47f4-4ac2-8b00-c2094ae08e74 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:09.045740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0571-47f4-4ac2-8b00-c2094ae08e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:09.046211 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0571-47f4-4ac2-8b00-c2094ae08e74 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:09.047045 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f0571-47f4-4ac2-8b00-c2094ae08e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:09.050074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f0571-47f4-4ac2-8b00-c2094ae08e74 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:09.073348 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1346/2691] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:04:08 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:04:09.077434 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc131fd-bfea-48ec-8a10-cc1049820a99 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:09.087480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc131fd-bfea-48ec-8a10-cc1049820a99 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:09.091977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d05a8-54e4-4f23-8331-2f1f522a8018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:09.092632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d05a8-54e4-4f23-8331-2f1f522a8018 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:09.092911 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d05a8-54e4-4f23-8331-2f1f522a8018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:09.093182 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d05a8-54e4-4f23-8331-2f1f522a8018 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:09.093934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d05a8-54e4-4f23-8331-2f1f522a8018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:09.095514 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d05a8-54e4-4f23-8331-2f1f522a8018 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:09.108145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1346/2692] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:09.112306 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0571-47f4-4ac2-8b00-c2094ae08e74 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:09.123553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0571-47f4-4ac2-8b00-c2094ae08e74 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:09.130216 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82d200-16b9-4b35-afaa-90a7db1562e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:09.130892 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82d200-16b9-4b35-afaa-90a7db1562e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:09.131168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82d200-16b9-4b35-afaa-90a7db1562e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:09.131436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82d200-16b9-4b35-afaa-90a7db1562e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:09.132152 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82d200-16b9-4b35-afaa-90a7db1562e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:09.133796 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82d200-16b9-4b35-afaa-90a7db1562e7 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:09.147277 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1347/2693] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:09.148568 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d05a8-54e4-4f23-8331-2f1f522a8018 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:09.158499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d05a8-54e4-4f23-8331-2f1f522a8018 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:09.162951 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50512c-578e-4ce1-8ffc-58518f4079c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:09.163821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50512c-578e-4ce1-8ffc-58518f4079c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:09.164112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50512c-578e-4ce1-8ffc-58518f4079c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:09.164385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50512c-578e-4ce1-8ffc-58518f4079c3 admin admin] PATH_INFO: `/v3/projects/8e0c53091dab4ba790155c256f29db1f/users/45ce0414c1e84e52ad6dc6f840e4f658/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:09.181488 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50512c-578e-4ce1-8ffc-58518f4079c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0c53091dab4ba790155c256f29db1f, user_id=45ce0414c1e84e52ad6dc6f840e4f658, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:09.184362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50512c-578e-4ce1-8ffc-58518f4079c3 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:09.200418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1347/2694] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:09 2022] PUT /identity/v3/projects/8e0c53091dab4ba790155c256f29db1f/users/45ce0414c1e84e52ad6dc6f840e4f658/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:04:09.205634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04a0c5-3ab7-4106-81da-52a9567a8ea6 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:09.206043 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04a0c5-3ab7-4106-81da-52a9567a8ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:09.206328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04a0c5-3ab7-4106-81da-52a9567a8ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:09.224248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-df04a0c5-3ab7-4106-81da-52a9567a8ea6 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:09.225483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-df04a0c5-3ab7-4106-81da-52a9567a8ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:09.295082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1348/2695] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:09.303323 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50512c-578e-4ce1-8ffc-58518f4079c3 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:09.305960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0c50512c-578e-4ce1-8ffc-58518f4079c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:09.368218 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50512c-578e-4ce1-8ffc-58518f4079c3 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:09.371392 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255865-bf3b-49a9-a03c-8f6e4305fbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:09.372051 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255865-bf3b-49a9-a03c-8f6e4305fbdf service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:09.372336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255865-bf3b-49a9-a03c-8f6e4305fbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:09.372609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255865-bf3b-49a9-a03c-8f6e4305fbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:09.386894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac255865-bf3b-49a9-a03c-8f6e4305fbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:09.388533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac255865-bf3b-49a9-a03c-8f6e4305fbdf service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:09.399803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1348/2696] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:12.750138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04a0c5-3ab7-4106-81da-52a9567a8ea6 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:12.751756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-df04a0c5-3ab7-4106-81da-52a9567a8ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:12.775717 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04a0c5-3ab7-4106-81da-52a9567a8ea6 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:12.787328 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:12.788504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:12.788953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:12.789255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] PATH_INFO: `/v3/users/8c6f7ac9ef024f70bbc74961b4b7b7bc` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:12.790532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6f7ac9ef024f70bbc74961b4b7b7bc)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:12.792488 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:12.866955 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6f7ac9ef024f70bbc74961b4b7b7bc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:12.874806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6f7ac9ef024f70bbc74961b4b7b7bc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:12.875666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6f7ac9ef024f70bbc74961b4b7b7bc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:12.876357 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6f7ac9ef024f70bbc74961b4b7b7bc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:12.888132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-43ebfd3f-e7e9-47f4-805e-0c286169be07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6f7ac9ef024f70bbc74961b4b7b7bc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:12.908688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1349/2697] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:12 2022] DELETE /identity/v3/users/8c6f7ac9ef024f70bbc74961b4b7b7bc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:13.151917 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255865-bf3b-49a9-a03c-8f6e4305fbdf service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:13.170310 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255865-bf3b-49a9-a03c-8f6e4305fbdf service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:13.245978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:13.247210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.247663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.248094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] PATH_INFO: `/v3/projects/75fc5dead879453695a0046c9f35ff1d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.249717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fc5dead879453695a0046c9f35ff1d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:13.252525 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:13.303972 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fc5dead879453695a0046c9f35ff1d', 'request_id': 'req-3cceec20-c717-415e-a081-5176ce9c13da'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:13.311978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fc5dead879453695a0046c9f35ff1d', 'request_id': 'req-3cceec20-c717-415e-a081-5176ce9c13da'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:13.322197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fc5dead879453695a0046c9f35ff1d', 'request_id': 'req-3cceec20-c717-415e-a081-5176ce9c13da'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:13.335604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] The token cache is being invalidate because project 75fc5dead879453695a0046c9f35ff1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:13.335906 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:13.336615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-3cceec20-c717-415e-a081-5176ce9c13da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:13.342186 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1349/2698] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:13 2022] DELETE /identity/v3/projects/75fc5dead879453695a0046c9f35ff1d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:13.344037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57897db5-997e-41c0-b5d7-b93e4e8fd4f2 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.344395 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57897db5-997e-41c0-b5d7-b93e4e8fd4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.344789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57897db5-997e-41c0-b5d7-b93e4e8fd4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.371769 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-57897db5-997e-41c0-b5d7-b93e4e8fd4f2 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:13.373104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-57897db5-997e-41c0-b5d7-b93e4e8fd4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:13.435660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1350/2699] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:13.449541 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ac0e3-f6ce-4adb-9c7a-26f3f017b338 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.449887 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ac0e3-f6ce-4adb-9c7a-26f3f017b338 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.450098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ac0e3-f6ce-4adb-9c7a-26f3f017b338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.475491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0b8ac0e3-f6ce-4adb-9c7a-26f3f017b338 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:13.476709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0b8ac0e3-f6ce-4adb-9c7a-26f3f017b338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:13.486503 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1350/2700] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:13.491342 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57897db5-997e-41c0-b5d7-b93e4e8fd4f2 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:13.505627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57897db5-997e-41c0-b5d7-b93e4e8fd4f2 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:13.512920 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b3fa1-c197-49a8-a299-a2027e1fae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:13.513660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b3fa1-c197-49a8-a299-a2027e1fae80 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.514410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b3fa1-c197-49a8-a299-a2027e1fae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.514704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b3fa1-c197-49a8-a299-a2027e1fae80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.516037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b3fa1-c197-49a8-a299-a2027e1fae80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:04:13.516353 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b3fa1-c197-49a8-a299-a2027e1fae80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:13.518786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b3fa1-c197-49a8-a299-a2027e1fae80 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:13.536170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1351/2701] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:04:13.540330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ac0e3-f6ce-4adb-9c7a-26f3f017b338 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:13.551793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ac0e3-f6ce-4adb-9c7a-26f3f017b338 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:13.557504 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2c7e2-f433-4ec8-b04b-82e810976418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:13.558255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2c7e2-f433-4ec8-b04b-82e810976418 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.558606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2c7e2-f433-4ec8-b04b-82e810976418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.560025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2c7e2-f433-4ec8-b04b-82e810976418 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.560025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2c7e2-f433-4ec8-b04b-82e810976418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:13.561709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2c7e2-f433-4ec8-b04b-82e810976418 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:13.609663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1351/2702] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:04:13 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:13.613659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b3fa1-c197-49a8-a299-a2027e1fae80 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:13.625241 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b3fa1-c197-49a8-a299-a2027e1fae80 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:13.732174 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c71abe-bc05-482b-8325-dde3f6322ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:13.733692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71abe-bc05-482b-8325-dde3f6322ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.734209 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71abe-bc05-482b-8325-dde3f6322ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.734775 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c71abe-bc05-482b-8325-dde3f6322ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.737791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c71abe-bc05-482b-8325-dde3f6322ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:13.740693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c71abe-bc05-482b-8325-dde3f6322ec1 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:13.782234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1352/2703] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:04:13 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:13.786635 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2c7e2-f433-4ec8-b04b-82e810976418 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:13.800129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2c7e2-f433-4ec8-b04b-82e810976418 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:13.811481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280e0c-2f98-463f-bfa6-e5a8846eb70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:13.812192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280e0c-2f98-463f-bfa6-e5a8846eb70f admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.812473 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280e0c-2f98-463f-bfa6-e5a8846eb70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.814035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15280e0c-2f98-463f-bfa6-e5a8846eb70f admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.814035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15280e0c-2f98-463f-bfa6-e5a8846eb70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:13.815174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15280e0c-2f98-463f-bfa6-e5a8846eb70f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:13.826671 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1352/2704] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:04:13.830433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c71abe-bc05-482b-8325-dde3f6322ec1 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:13.849387 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c71abe-bc05-482b-8325-dde3f6322ec1 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:13.855538 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde2165-f75d-41cc-9691-9e1b7de6570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:13.856471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde2165-f75d-41cc-9691-9e1b7de6570b admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.857617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde2165-f75d-41cc-9691-9e1b7de6570b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.858079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde2165-f75d-41cc-9691-9e1b7de6570b admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.859023 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde2165-f75d-41cc-9691-9e1b7de6570b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:13.861812 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde2165-f75d-41cc-9691-9e1b7de6570b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:13.883438 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1353/2705] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:04:13.887454 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280e0c-2f98-463f-bfa6-e5a8846eb70f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:13.899800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15280e0c-2f98-463f-bfa6-e5a8846eb70f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:13.910049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76e5fa-a48b-47b8-abf9-e594305de6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:13.910899 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e5fa-a48b-47b8-abf9-e594305de6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.911179 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e5fa-a48b-47b8-abf9-e594305de6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.911450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e5fa-a48b-47b8-abf9-e594305de6ee admin admin] PATH_INFO: `/v3/projects/c4c6e5d061954a0da6bb4ebf09e44af6/users/b32f1ccbb69048afbffa55f79f175e4e/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.931352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76e5fa-a48b-47b8-abf9-e594305de6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c6e5d061954a0da6bb4ebf09e44af6, user_id=b32f1ccbb69048afbffa55f79f175e4e, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:13.934180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76e5fa-a48b-47b8-abf9-e594305de6ee admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:13.949715 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1353/2706] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:13 2022] PUT /identity/v3/projects/c4c6e5d061954a0da6bb4ebf09e44af6/users/b32f1ccbb69048afbffa55f79f175e4e/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:13.960031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb19d5b-8291-471a-9b02-d9a17a168dc4 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:13.960581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb19d5b-8291-471a-9b02-d9a17a168dc4 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:13.961057 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb19d5b-8291-471a-9b02-d9a17a168dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:13.995147 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-bdb19d5b-8291-471a-9b02-d9a17a168dc4 None None] MFA Rules not processed for user `b32f1ccbb69048afbffa55f79f175e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:13.996384 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-bdb19d5b-8291-471a-9b02-d9a17a168dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:14.080041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1354/2707] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:14.092739 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76e5fa-a48b-47b8-abf9-e594305de6ee admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:14.094603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ed76e5fa-a48b-47b8-abf9-e594305de6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:14.199645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76e5fa-a48b-47b8-abf9-e594305de6ee admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:14.206575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5755a04-61a3-430a-9867-11aa5ffb56f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:14.207254 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5755a04-61a3-430a-9867-11aa5ffb56f5 service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:14.207518 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5755a04-61a3-430a-9867-11aa5ffb56f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:14.207789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5755a04-61a3-430a-9867-11aa5ffb56f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:14.216645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5755a04-61a3-430a-9867-11aa5ffb56f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:14.218256 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5755a04-61a3-430a-9867-11aa5ffb56f5 service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:14.230456 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1354/2708] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:14.591133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98207-1a5d-4b36-b168-53a73860e638 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:14.594704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98207-1a5d-4b36-b168-53a73860e638 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:14.594704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98207-1a5d-4b36-b168-53a73860e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:14.674710 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6ee98207-1a5d-4b36-b168-53a73860e638 None None] MFA Rules not processed for user `45ce0414c1e84e52ad6dc6f840e4f658`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:14.676540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6ee98207-1a5d-4b36-b168-53a73860e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:14.792101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1355/2709] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:14.797217 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5755a04-61a3-430a-9867-11aa5ffb56f5 service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:14.798885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c5755a04-61a3-430a-9867-11aa5ffb56f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:14.873190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5755a04-61a3-430a-9867-11aa5ffb56f5 service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:14.878138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1cef-5681-4d0d-bf6b-24652635c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:14.879066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1cef-5681-4d0d-bf6b-24652635c625 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:14.879279 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1cef-5681-4d0d-bf6b-24652635c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:14.879575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1cef-5681-4d0d-bf6b-24652635c625 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:14.880259 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1cef-5681-4d0d-bf6b-24652635c625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:14.882268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1cef-5681-4d0d-bf6b-24652635c625 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:14.910556 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1355/2710] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:04:14 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:14.914827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee98207-1a5d-4b36-b168-53a73860e638 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:14.926600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee98207-1a5d-4b36-b168-53a73860e638 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:14.993634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c54c8-901a-464e-81b5-374e7f6d4b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:14.994352 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c54c8-901a-464e-81b5-374e7f6d4b47 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:14.994636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c54c8-901a-464e-81b5-374e7f6d4b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:14.994913 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c54c8-901a-464e-81b5-374e7f6d4b47 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:14.995639 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c54c8-901a-464e-81b5-374e7f6d4b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:14.997638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c54c8-901a-464e-81b5-374e7f6d4b47 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:15.018609 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1356/2711] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:04:14 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:15.022853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1cef-5681-4d0d-bf6b-24652635c625 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:15.033539 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1cef-5681-4d0d-bf6b-24652635c625 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:15.039161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64c730-4c2b-43e6-9a40-c628bcb0b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:15.039745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64c730-4c2b-43e6-9a40-c628bcb0b8fb admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:15.040099 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64c730-4c2b-43e6-9a40-c628bcb0b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:15.040301 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64c730-4c2b-43e6-9a40-c628bcb0b8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:15.041037 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64c730-4c2b-43e6-9a40-c628bcb0b8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:15.042687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64c730-4c2b-43e6-9a40-c628bcb0b8fb admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:15.056224 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1356/2712] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:15.060602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c54c8-901a-464e-81b5-374e7f6d4b47 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:15.070959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c54c8-901a-464e-81b5-374e7f6d4b47 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:15.075866 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b2d37-f5e6-4a6e-8030-3966cad48179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:15.076763 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b2d37-f5e6-4a6e-8030-3966cad48179 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:15.077047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b2d37-f5e6-4a6e-8030-3966cad48179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:15.077349 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b2d37-f5e6-4a6e-8030-3966cad48179 admin admin] PATH_INFO: `/v3/projects/df88434689bc42f28ac209a7140d2e87/users/383db515377f4d979257201227cc87a4/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:15.095557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b2d37-f5e6-4a6e-8030-3966cad48179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df88434689bc42f28ac209a7140d2e87, user_id=383db515377f4d979257201227cc87a4, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:15.099816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b2d37-f5e6-4a6e-8030-3966cad48179 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:15.126148 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1357/2713] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:15 2022] PUT /identity/v3/projects/df88434689bc42f28ac209a7140d2e87/users/383db515377f4d979257201227cc87a4/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:15.130509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64c730-4c2b-43e6-9a40-c628bcb0b8fb admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:15.141609 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64c730-4c2b-43e6-9a40-c628bcb0b8fb admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:15.200251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfddee-17fd-4553-9070-dc16413018eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:15.200251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfddee-17fd-4553-9070-dc16413018eb admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:15.200251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfddee-17fd-4553-9070-dc16413018eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:15.201110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfddee-17fd-4553-9070-dc16413018eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:15.201447 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfddee-17fd-4553-9070-dc16413018eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:15.203092 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfddee-17fd-4553-9070-dc16413018eb admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:15.214786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1357/2714] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:15.219212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b2d37-f5e6-4a6e-8030-3966cad48179 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:15.233255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b2d37-f5e6-4a6e-8030-3966cad48179 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:15.240461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7fd6c-9042-44bf-ab63-3a900d7c99d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:15.241785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7fd6c-9042-44bf-ab63-3a900d7c99d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:15.243681 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7fd6c-9042-44bf-ab63-3a900d7c99d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:15.244244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7fd6c-9042-44bf-ab63-3a900d7c99d7 admin admin] PATH_INFO: `/v3/projects/df88434689bc42f28ac209a7140d2e87/users/383db515377f4d979257201227cc87a4/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:15.246574 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7fd6c-9042-44bf-ab63-3a900d7c99d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df88434689bc42f28ac209a7140d2e87, user_id=383db515377f4d979257201227cc87a4, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:15.252571 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7fd6c-9042-44bf-ab63-3a900d7c99d7 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:15.266538 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1358/2715] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:15 2022] PUT /identity/v3/projects/df88434689bc42f28ac209a7140d2e87/users/383db515377f4d979257201227cc87a4/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:17.183574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfddee-17fd-4553-9070-dc16413018eb admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:17.194383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfddee-17fd-4553-9070-dc16413018eb admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:17.257778 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:17.258890 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:17.259352 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:17.259789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] PATH_INFO: `/v3/users/b32f1ccbb69048afbffa55f79f175e4e` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:17.261341 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32f1ccbb69048afbffa55f79f175e4e)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:17.263478 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:17.317263 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32f1ccbb69048afbffa55f79f175e4e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:17.325442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32f1ccbb69048afbffa55f79f175e4e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:17.326537 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32f1ccbb69048afbffa55f79f175e4e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:17.329949 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32f1ccbb69048afbffa55f79f175e4e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:17.340271 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32f1ccbb69048afbffa55f79f175e4e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:17.368216 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1358/2716] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:17 2022] DELETE /identity/v3/users/b32f1ccbb69048afbffa55f79f175e4e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:17.372937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b322ef5-7a26-44e5-9162-326c445401c9 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:17.376172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b322ef5-7a26-44e5-9162-326c445401c9 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:17.376483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b322ef5-7a26-44e5-9162-326c445401c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:17.403656 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-6b322ef5-7a26-44e5-9162-326c445401c9 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:17.404895 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6b322ef5-7a26-44e5-9162-326c445401c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:17.507107 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1359/2717] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:17.517636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:17.520370 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:17.611410 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228829f-08e3-4ce4-96a8-6aca00300f93 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:17.616938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f28c26-a32f-4089-951d-50961e8d49b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:17.617802 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f28c26-a32f-4089-951d-50961e8d49b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:17.618197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f28c26-a32f-4089-951d-50961e8d49b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:17.618561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f28c26-a32f-4089-951d-50961e8d49b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:17.629643 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f28c26-a32f-4089-951d-50961e8d49b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:17.631362 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f28c26-a32f-4089-951d-50961e8d49b1 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:17.653724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1359/2718] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:18.153947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b322ef5-7a26-44e5-9162-326c445401c9 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:18.156450 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6b322ef5-7a26-44e5-9162-326c445401c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:18.171552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b322ef5-7a26-44e5-9162-326c445401c9 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:18.178379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:18.179751 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:18.180195 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:18.180705 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] PATH_INFO: `/v3/projects/c4c6e5d061954a0da6bb4ebf09e44af6` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:18.183339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c6e5d061954a0da6bb4ebf09e44af6)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:18.185533 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:18.289543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c6e5d061954a0da6bb4ebf09e44af6', 'request_id': 'req-39d72219-4918-407d-a4b1-90d6f01d3291'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:18.301227 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c6e5d061954a0da6bb4ebf09e44af6', 'request_id': 'req-39d72219-4918-407d-a4b1-90d6f01d3291'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:18.309578 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c6e5d061954a0da6bb4ebf09e44af6', 'request_id': 'req-39d72219-4918-407d-a4b1-90d6f01d3291'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:18.322862 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] The token cache is being invalidate because project c4c6e5d061954a0da6bb4ebf09e44af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:18.323468 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:18.324421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-39d72219-4918-407d-a4b1-90d6f01d3291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:18.329018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1360/2719] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:18 2022] DELETE /identity/v3/projects/c4c6e5d061954a0da6bb4ebf09e44af6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:18.334123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0ec9e-9a9e-4ae9-b4bc-98297f11bd14 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:18.334606 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0ec9e-9a9e-4ae9-b4bc-98297f11bd14 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:18.334699 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0ec9e-9a9e-4ae9-b4bc-98297f11bd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:18.357538 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-36a0ec9e-9a9e-4ae9-b4bc-98297f11bd14 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:18.359627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-36a0ec9e-9a9e-4ae9-b4bc-98297f11bd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:18.467642 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1360/2720] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:04:18.475756 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067b443-a32f-42e5-bdfb-4d3003c63bbc None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:18.476456 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067b443-a32f-42e5-bdfb-4d3003c63bbc None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:18.476859 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067b443-a32f-42e5-bdfb-4d3003c63bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:18.514822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b067b443-a32f-42e5-bdfb-4d3003c63bbc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:18.520587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b067b443-a32f-42e5-bdfb-4d3003c63bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:18.540996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1361/2721] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:04:18.545561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0ec9e-9a9e-4ae9-b4bc-98297f11bd14 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:18.557145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0ec9e-9a9e-4ae9-b4bc-98297f11bd14 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:18.563268 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468c7a-aa44-4339-afe9-58c3fc31e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:18.564249 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468c7a-aa44-4339-afe9-58c3fc31e246 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:18.564901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468c7a-aa44-4339-afe9-58c3fc31e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:18.565526 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468c7a-aa44-4339-afe9-58c3fc31e246 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:18.567375 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468c7a-aa44-4339-afe9-58c3fc31e246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:04:18.567723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468c7a-aa44-4339-afe9-58c3fc31e246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:18.569449 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468c7a-aa44-4339-afe9-58c3fc31e246 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:18.596396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1361/2722] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:04:18.601085 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067b443-a32f-42e5-bdfb-4d3003c63bbc None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:18.612485 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067b443-a32f-42e5-bdfb-4d3003c63bbc None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:18.618333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2534d12-26c1-4a6d-9aea-f71097fb6d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:18.619265 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2534d12-26c1-4a6d-9aea-f71097fb6d20 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:18.619728 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2534d12-26c1-4a6d-9aea-f71097fb6d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:18.620280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2534d12-26c1-4a6d-9aea-f71097fb6d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:18.621372 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2534d12-26c1-4a6d-9aea-f71097fb6d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:18.623745 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2534d12-26c1-4a6d-9aea-f71097fb6d20 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:18.669017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1362/2723] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:04:18 2022] POST /identity/v3/projects => generated 357 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:18.670385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468c7a-aa44-4339-afe9-58c3fc31e246 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:18.681443 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468c7a-aa44-4339-afe9-58c3fc31e246 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:18.779756 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84cdbf-5bea-4399-aa5c-1d3502c46bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:18.780533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84cdbf-5bea-4399-aa5c-1d3502c46bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:18.780814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84cdbf-5bea-4399-aa5c-1d3502c46bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:18.781089 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84cdbf-5bea-4399-aa5c-1d3502c46bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:18.781985 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84cdbf-5bea-4399-aa5c-1d3502c46bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:18.788481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84cdbf-5bea-4399-aa5c-1d3502c46bb7 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:18.826442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1362/2724] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:04:18 2022] POST /identity/v3/users => generated 279 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:18.828254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2534d12-26c1-4a6d-9aea-f71097fb6d20 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:18.842194 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2534d12-26c1-4a6d-9aea-f71097fb6d20 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:18.849127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade303a-60a1-4e37-970d-7f74b1c7521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:18.849127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade303a-60a1-4e37-970d-7f74b1c7521f admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:18.849697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade303a-60a1-4e37-970d-7f74b1c7521f admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:18.850079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade303a-60a1-4e37-970d-7f74b1c7521f admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:18.851746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade303a-60a1-4e37-970d-7f74b1c7521f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:18.853978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade303a-60a1-4e37-970d-7f74b1c7521f admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:18.868773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1363/2725] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:18.872598 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84cdbf-5bea-4399-aa5c-1d3502c46bb7 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:18.886325 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84cdbf-5bea-4399-aa5c-1d3502c46bb7 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:18.899580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7e584-cfb4-4856-9272-b71bcad96fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:18.900638 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e584-cfb4-4856-9272-b71bcad96fad admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:18.900926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e584-cfb4-4856-9272-b71bcad96fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:18.901303 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e584-cfb4-4856-9272-b71bcad96fad admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:18.902194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7e584-cfb4-4856-9272-b71bcad96fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:18.906398 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7e584-cfb4-4856-9272-b71bcad96fad admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:18.935419 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1363/2726] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:18.938786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade303a-60a1-4e37-970d-7f74b1c7521f admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:18.953934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade303a-60a1-4e37-970d-7f74b1c7521f admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:18.960096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668b39-034a-4194-a1b7-c7ff74870f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:18.961018 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668b39-034a-4194-a1b7-c7ff74870f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:18.961310 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668b39-034a-4194-a1b7-c7ff74870f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:18.962105 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668b39-034a-4194-a1b7-c7ff74870f56 admin admin] PATH_INFO: `/v3/projects/c0d6da5dede84690af5ca9cb6f563eec/users/3f21e98051414def863f35de7471c622/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:18.996718 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09668b39-034a-4194-a1b7-c7ff74870f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d6da5dede84690af5ca9cb6f563eec, user_id=3f21e98051414def863f35de7471c622, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:18.999870 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09668b39-034a-4194-a1b7-c7ff74870f56 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:19.033225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1364/2727] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:18 2022] PUT /identity/v3/projects/c0d6da5dede84690af5ca9cb6f563eec/users/3f21e98051414def863f35de7471c622/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:19.035236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd886409-9d9f-47c6-9a8d-3710a718836b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:19.035534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd886409-9d9f-47c6-9a8d-3710a718836b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:19.035814 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd886409-9d9f-47c6-9a8d-3710a718836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:19.097192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-fd886409-9d9f-47c6-9a8d-3710a718836b None None] MFA Rules not processed for user `3f21e98051414def863f35de7471c622`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:19.099464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-fd886409-9d9f-47c6-9a8d-3710a718836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:19.211829 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1364/2728] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:19 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:19.216162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668b39-034a-4194-a1b7-c7ff74870f56 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:19.308602 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668b39-034a-4194-a1b7-c7ff74870f56 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:19.315624 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af58b8e-a476-4c31-8d9b-e29c5e719ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:19.316132 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58b8e-a476-4c31-8d9b-e29c5e719ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:19.316512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58b8e-a476-4c31-8d9b-e29c5e719ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:19.317101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58b8e-a476-4c31-8d9b-e29c5e719ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:19.317749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af58b8e-a476-4c31-8d9b-e29c5e719ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:19.324698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af58b8e-a476-4c31-8d9b-e29c5e719ad0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:19.368929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1365/2729] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:04:19 2022] POST /identity/v3/projects => generated 357 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:04:19.371063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd886409-9d9f-47c6-9a8d-3710a718836b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:19.409510 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd886409-9d9f-47c6-9a8d-3710a718836b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:19.505771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37d9de-30d0-4df3-870c-f9629140640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:19.506884 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37d9de-30d0-4df3-870c-f9629140640c admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:19.507350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37d9de-30d0-4df3-870c-f9629140640c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:19.507981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37d9de-30d0-4df3-870c-f9629140640c admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:19.509019 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37d9de-30d0-4df3-870c-f9629140640c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:19.516313 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37d9de-30d0-4df3-870c-f9629140640c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:19.552825 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1365/2730] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:04:19 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:19.556500 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af58b8e-a476-4c31-8d9b-e29c5e719ad0 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:19.569242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af58b8e-a476-4c31-8d9b-e29c5e719ad0 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:19.574644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730f52a-7598-46ba-aff9-16c7667cf618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:19.575400 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730f52a-7598-46ba-aff9-16c7667cf618 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:19.575891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730f52a-7598-46ba-aff9-16c7667cf618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:19.576232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730f52a-7598-46ba-aff9-16c7667cf618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:19.577095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730f52a-7598-46ba-aff9-16c7667cf618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:19.578990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730f52a-7598-46ba-aff9-16c7667cf618 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:19.591744 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1366/2731] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:19.596391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37d9de-30d0-4df3-870c-f9629140640c admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:19.615314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37d9de-30d0-4df3-870c-f9629140640c admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:19.621934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aa2a3-c290-4bd9-9207-9c386e98de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:19.623129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa2a3-c290-4bd9-9207-9c386e98de1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:19.623354 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa2a3-c290-4bd9-9207-9c386e98de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:19.623959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa2a3-c290-4bd9-9207-9c386e98de1e admin admin] PATH_INFO: `/v3/projects/857436c0137347f18d63bddf2c49f48c/users/c52a8741215148cdbf881ebf6444da3e/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:19.643763 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aa2a3-c290-4bd9-9207-9c386e98de1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=857436c0137347f18d63bddf2c49f48c, user_id=c52a8741215148cdbf881ebf6444da3e, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:19.647493 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aa2a3-c290-4bd9-9207-9c386e98de1e admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:19.669900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1366/2732] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:19 2022] PUT /identity/v3/projects/857436c0137347f18d63bddf2c49f48c/users/c52a8741215148cdbf881ebf6444da3e/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:19.673614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730f52a-7598-46ba-aff9-16c7667cf618 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:19.693238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730f52a-7598-46ba-aff9-16c7667cf618 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:19.793764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48347285-1a6f-425a-8084-3e75e30699ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:19.794628 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48347285-1a6f-425a-8084-3e75e30699ec admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:19.795006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48347285-1a6f-425a-8084-3e75e30699ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:19.796693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48347285-1a6f-425a-8084-3e75e30699ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:19.798180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48347285-1a6f-425a-8084-3e75e30699ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:19.802853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48347285-1a6f-425a-8084-3e75e30699ec admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:19.822238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1367/2733] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:19.823889 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aa2a3-c290-4bd9-9207-9c386e98de1e admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:19.837720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aa2a3-c290-4bd9-9207-9c386e98de1e admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:19.847592 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ce804-f8e1-4438-a1e1-f2f84b57d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:19.850024 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ce804-f8e1-4438-a1e1-f2f84b57d966 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:19.850441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ce804-f8e1-4438-a1e1-f2f84b57d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:19.850723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ce804-f8e1-4438-a1e1-f2f84b57d966 admin admin] PATH_INFO: `/v3/projects/857436c0137347f18d63bddf2c49f48c/users/c52a8741215148cdbf881ebf6444da3e/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:19.855115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ce804-f8e1-4438-a1e1-f2f84b57d966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=857436c0137347f18d63bddf2c49f48c, user_id=c52a8741215148cdbf881ebf6444da3e, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:19.869183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ce804-f8e1-4438-a1e1-f2f84b57d966 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:19.886702 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1367/2734] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:19 2022] PUT /identity/v3/projects/857436c0137347f18d63bddf2c49f48c/users/c52a8741215148cdbf881ebf6444da3e/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:19.899512 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4e57a-4940-4420-a1e5-af61a44a9cee None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:19.899929 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4e57a-4940-4420-a1e5-af61a44a9cee None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:19.900617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4e57a-4940-4420-a1e5-af61a44a9cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:19.958474 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-3ba4e57a-4940-4420-a1e5-af61a44a9cee None None] MFA Rules not processed for user `c52a8741215148cdbf881ebf6444da3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:19.960248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3ba4e57a-4940-4420-a1e5-af61a44a9cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:20.068041 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1368/2735] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:19 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:20.075730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ce804-f8e1-4438-a1e1-f2f84b57d966 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:20.077604 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-488ce804-f8e1-4438-a1e1-f2f84b57d966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:20.146049 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ce804-f8e1-4438-a1e1-f2f84b57d966 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:20.150650 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f8337-17e6-4c37-9dba-ee7d120c912b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:20.151382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f8337-17e6-4c37-9dba-ee7d120c912b service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:20.151790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f8337-17e6-4c37-9dba-ee7d120c912b service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:20.152124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f8337-17e6-4c37-9dba-ee7d120c912b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:20.164934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f8337-17e6-4c37-9dba-ee7d120c912b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:20.166483 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f8337-17e6-4c37-9dba-ee7d120c912b service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:20.176564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1368/2736] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:20.265580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4e57a-4940-4420-a1e5-af61a44a9cee None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:20.276175 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4e57a-4940-4420-a1e5-af61a44a9cee None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:20.280304 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1f8b2-45b5-48c6-87a7-5f953672dbc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:20.280976 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f8b2-45b5-48c6-87a7-5f953672dbc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:20.281254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f8b2-45b5-48c6-87a7-5f953672dbc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:20.281614 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f8b2-45b5-48c6-87a7-5f953672dbc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:20.340205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f8b2-45b5-48c6-87a7-5f953672dbc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:20.341591 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f8b2-45b5-48c6-87a7-5f953672dbc9 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:20.351267 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1369/2737] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:20 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:20.636124 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50075fe-be0b-4955-8a0f-db76add65087 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:20.637058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50075fe-be0b-4955-8a0f-db76add65087 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:20.637624 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50075fe-be0b-4955-8a0f-db76add65087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:20.666031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d50075fe-be0b-4955-8a0f-db76add65087 None None] MFA Rules not processed for user `383db515377f4d979257201227cc87a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:20.667293 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d50075fe-be0b-4955-8a0f-db76add65087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:20.735727 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1369/2738] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:20.748393 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1f8b2-45b5-48c6-87a7-5f953672dbc9 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:20.749883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cee1f8b2-45b5-48c6-87a7-5f953672dbc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:20.843545 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1f8b2-45b5-48c6-87a7-5f953672dbc9 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:20.849104 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fa9ac-08ac-43a8-a76b-cbe4447a8b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:20.849807 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa9ac-08ac-43a8-a76b-cbe4447a8b25 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:20.850086 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa9ac-08ac-43a8-a76b-cbe4447a8b25 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:20.850362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa9ac-08ac-43a8-a76b-cbe4447a8b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:20.853638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-0b7fa9ac-08ac-43a8-a76b-cbe4447a8b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:20.925471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fa9ac-08ac-43a8-a76b-cbe4447a8b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:20.927071 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fa9ac-08ac-43a8-a76b-cbe4447a8b25 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:20.938279 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1370/2739] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:39.148196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50075fe-be0b-4955-8a0f-db76add65087 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:39.149867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d50075fe-be0b-4955-8a0f-db76add65087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:39.218668 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50075fe-be0b-4955-8a0f-db76add65087 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:39.223593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:39.224461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:39.224732 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:39.224997 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] PATH_INFO: `/v3/users/b39e429a52c44d7ba736f605ea250717` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:39.226237 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39e429a52c44d7ba736f605ea250717)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:39.228210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:39.278274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39e429a52c44d7ba736f605ea250717'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.284612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39e429a52c44d7ba736f605ea250717'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.285248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39e429a52c44d7ba736f605ea250717'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.285942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39e429a52c44d7ba736f605ea250717'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.296149 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39e429a52c44d7ba736f605ea250717'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.313605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1370/2740] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:39 2022] DELETE /identity/v3/users/b39e429a52c44d7ba736f605ea250717 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:04:39.318343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4b280-2d7b-4ac0-b7c5-5f15a130342a None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:39.318818 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4b280-2d7b-4ac0-b7c5-5f15a130342a None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:39.318994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4b280-2d7b-4ac0-b7c5-5f15a130342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:39.336968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-91d4b280-2d7b-4ac0-b7c5-5f15a130342a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:39.338299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-91d4b280-2d7b-4ac0-b7c5-5f15a130342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:39.397599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1371/2741] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:39.407705 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:39.409377 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:39.465892 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b030c-e543-4997-a427-a5f82bb8e1e0 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:39.469587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d013e-9d8e-4989-a111-3fda4fecf5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:39.470234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d013e-9d8e-4989-a111-3fda4fecf5ef service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:39.470512 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d013e-9d8e-4989-a111-3fda4fecf5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:39.470781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d013e-9d8e-4989-a111-3fda4fecf5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:39.481102 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d013e-9d8e-4989-a111-3fda4fecf5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:39.482711 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d013e-9d8e-4989-a111-3fda4fecf5ef service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:39.494581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1371/2742] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:39.780239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4b280-2d7b-4ac0-b7c5-5f15a130342a None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:39.782410 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-91d4b280-2d7b-4ac0-b7c5-5f15a130342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:39.795657 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4b280-2d7b-4ac0-b7c5-5f15a130342a None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:39.800759 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:39.801711 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:39.802040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:39.802318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] PATH_INFO: `/v3/projects/d8ff272c8b0c4e79be087bec9a4f7286` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:39.803608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ff272c8b0c4e79be087bec9a4f7286)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:39.805579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:39.861225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ff272c8b0c4e79be087bec9a4f7286', 'request_id': 'req-5db89290-4d23-44e0-b520-9d545f8f2ac8'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.869527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ff272c8b0c4e79be087bec9a4f7286', 'request_id': 'req-5db89290-4d23-44e0-b520-9d545f8f2ac8'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.876140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ff272c8b0c4e79be087bec9a4f7286', 'request_id': 'req-5db89290-4d23-44e0-b520-9d545f8f2ac8'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.885820 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] The token cache is being invalidate because project d8ff272c8b0c4e79be087bec9a4f7286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:39.886099 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.886701 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5db89290-4d23-44e0-b520-9d545f8f2ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:39.888270 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1372/2743] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:39 2022] DELETE /identity/v3/projects/d8ff272c8b0c4e79be087bec9a4f7286 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:39.893403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793708-4d94-4329-bfb1-d24f0d457392 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:39.893789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793708-4d94-4329-bfb1-d24f0d457392 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:39.894119 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793708-4d94-4329-bfb1-d24f0d457392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:39.912337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-cb793708-4d94-4329-bfb1-d24f0d457392 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:39.913584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cb793708-4d94-4329-bfb1-d24f0d457392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:39.973591 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1372/2744] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:39.983180 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7594-c2ff-4500-ab40-abfe1e26ea92 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:39.983535 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7594-c2ff-4500-ab40-abfe1e26ea92 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:39.983878 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7594-c2ff-4500-ab40-abfe1e26ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.005722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c8ef7594-c2ff-4500-ab40-abfe1e26ea92 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:40.006926 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c8ef7594-c2ff-4500-ab40-abfe1e26ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:40.015997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1373/2745] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:40.020416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb793708-4d94-4329-bfb1-d24f0d457392 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:40.030594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb793708-4d94-4329-bfb1-d24f0d457392 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:40.035653 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aa9ce-af8c-429d-9cb9-27bd38dac035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:40.036308 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aa9ce-af8c-429d-9cb9-27bd38dac035 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.036585 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aa9ce-af8c-429d-9cb9-27bd38dac035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.036857 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aa9ce-af8c-429d-9cb9-27bd38dac035 admin admin] PATH_INFO: `/v3/domains` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.037617 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aa9ce-af8c-429d-9cb9-27bd38dac035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:04:40.037923 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aa9ce-af8c-429d-9cb9-27bd38dac035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:40.039555 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aa9ce-af8c-429d-9cb9-27bd38dac035 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:40.050881 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1373/2746] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:04:40.055080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef7594-c2ff-4500-ab40-abfe1e26ea92 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:40.064046 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef7594-c2ff-4500-ab40-abfe1e26ea92 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:40.069036 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e11ca7-e40d-4297-86ca-404058fd303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:40.069688 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e11ca7-e40d-4297-86ca-404058fd303c admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.069965 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e11ca7-e40d-4297-86ca-404058fd303c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.070253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e11ca7-e40d-4297-86ca-404058fd303c admin admin] PATH_INFO: `/v3/projects` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.070945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e11ca7-e40d-4297-86ca-404058fd303c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:40.072853 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e11ca7-e40d-4297-86ca-404058fd303c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:40.100934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1374/2747] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:04:40 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:04:40.105077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aa9ce-af8c-429d-9cb9-27bd38dac035 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:40.115309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aa9ce-af8c-429d-9cb9-27bd38dac035 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:40.173321 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453915c9-5fb8-4e47-8b14-09372f9a77e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:40.173953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453915c9-5fb8-4e47-8b14-09372f9a77e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.174260 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453915c9-5fb8-4e47-8b14-09372f9a77e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.174531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453915c9-5fb8-4e47-8b14-09372f9a77e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.175209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453915c9-5fb8-4e47-8b14-09372f9a77e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:40.177120 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453915c9-5fb8-4e47-8b14-09372f9a77e0 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:40.200095 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1374/2748] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:04:40 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:40.204131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e11ca7-e40d-4297-86ca-404058fd303c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:40.214285 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e11ca7-e40d-4297-86ca-404058fd303c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:40.219721 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39726a5-03be-45a0-acb1-969bfaf04b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:40.220381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39726a5-03be-45a0-acb1-969bfaf04b31 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.220659 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39726a5-03be-45a0-acb1-969bfaf04b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.220930 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39726a5-03be-45a0-acb1-969bfaf04b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.221708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39726a5-03be-45a0-acb1-969bfaf04b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:40.223305 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39726a5-03be-45a0-acb1-969bfaf04b31 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:40.234087 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1375/2749] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:04:40.237933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453915c9-5fb8-4e47-8b14-09372f9a77e0 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:40.248293 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453915c9-5fb8-4e47-8b14-09372f9a77e0 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:40.253894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2111303-91b7-4be0-8830-159518181dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:40.254549 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111303-91b7-4be0-8830-159518181dac admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.254832 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111303-91b7-4be0-8830-159518181dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.255108 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111303-91b7-4be0-8830-159518181dac admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.255912 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2111303-91b7-4be0-8830-159518181dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:40.257634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2111303-91b7-4be0-8830-159518181dac admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:40.267860 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1375/2750] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:40.272025 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39726a5-03be-45a0-acb1-969bfaf04b31 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:40.281829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39726a5-03be-45a0-acb1-969bfaf04b31 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:40.287166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bb1ce-6617-4b43-8e71-f85577b1c03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:40.288044 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb1ce-6617-4b43-8e71-f85577b1c03d admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.288388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb1ce-6617-4b43-8e71-f85577b1c03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.288652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb1ce-6617-4b43-8e71-f85577b1c03d admin admin] PATH_INFO: `/v3/projects/030d9dd7d96d4c80b4f0d037ad76ce58/users/28a0835d913540f9a801ad1a714d52e8/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.302804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bb1ce-6617-4b43-8e71-f85577b1c03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=030d9dd7d96d4c80b4f0d037ad76ce58, user_id=28a0835d913540f9a801ad1a714d52e8, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:40.305522 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bb1ce-6617-4b43-8e71-f85577b1c03d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:40.320231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1376/2751] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:40 2022] PUT /identity/v3/projects/030d9dd7d96d4c80b4f0d037ad76ce58/users/28a0835d913540f9a801ad1a714d52e8/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:40.330724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596458b7-6429-4abd-b462-d2f9cc57f7f1 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.331015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596458b7-6429-4abd-b462-d2f9cc57f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.331292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596458b7-6429-4abd-b462-d2f9cc57f7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.358235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-596458b7-6429-4abd-b462-d2f9cc57f7f1 None None] MFA Rules not processed for user `28a0835d913540f9a801ad1a714d52e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:40.359437 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-596458b7-6429-4abd-b462-d2f9cc57f7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:40.424800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1376/2752] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:40.441617 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bb1ce-6617-4b43-8e71-f85577b1c03d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:40.444436 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6e3bb1ce-6617-4b43-8e71-f85577b1c03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:40.502430 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bb1ce-6617-4b43-8e71-f85577b1c03d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:40.506587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcc534-dfea-45d0-978c-89d4454300aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:40.507165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcc534-dfea-45d0-978c-89d4454300aa service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.507446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcc534-dfea-45d0-978c-89d4454300aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.507715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcc534-dfea-45d0-978c-89d4454300aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.516236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcc534-dfea-45d0-978c-89d4454300aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:40.517704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcc534-dfea-45d0-978c-89d4454300aa service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:40.526543 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1377/2753] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:40.553508 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596458b7-6429-4abd-b462-d2f9cc57f7f1 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:40.625429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596458b7-6429-4abd-b462-d2f9cc57f7f1 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:40.630232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:40.631104 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.631411 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.631681 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] PATH_INFO: `/v3/users/28a0835d913540f9a801ad1a714d52e8` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.632885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a0835d913540f9a801ad1a714d52e8)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:40.636516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:40.684716 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a0835d913540f9a801ad1a714d52e8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:40.691517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a0835d913540f9a801ad1a714d52e8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:40.692188 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a0835d913540f9a801ad1a714d52e8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:40.692785 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a0835d913540f9a801ad1a714d52e8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:40.700710 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a0835d913540f9a801ad1a714d52e8'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:40.718786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1377/2754] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:40 2022] DELETE /identity/v3/users/28a0835d913540f9a801ad1a714d52e8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:40.726228 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80329949-8b77-4d5e-8123-34f98036a744 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.726572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80329949-8b77-4d5e-8123-34f98036a744 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.726922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80329949-8b77-4d5e-8123-34f98036a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.744599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-80329949-8b77-4d5e-8123-34f98036a744 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:40.745952 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-80329949-8b77-4d5e-8123-34f98036a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:40.809868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1378/2755] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:40.819830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:40.821315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:40.879627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172717b-a6fa-4beb-9044-fa3b74858a65 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:40.883286 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d937c-8e3c-4758-b43a-7ded55410383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:40.883940 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d937c-8e3c-4758-b43a-7ded55410383 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:40.884219 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d937c-8e3c-4758-b43a-7ded55410383 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:40.884501 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d937c-8e3c-4758-b43a-7ded55410383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:40.894774 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d937c-8e3c-4758-b43a-7ded55410383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:40.896214 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d937c-8e3c-4758-b43a-7ded55410383 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:40.913141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1378/2756] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 19:04:41.175275 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80329949-8b77-4d5e-8123-34f98036a744 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:41.177144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-80329949-8b77-4d5e-8123-34f98036a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:41.193257 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80329949-8b77-4d5e-8123-34f98036a744 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:41.203137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:41.204097 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:41.204388 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:41.204709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] PATH_INFO: `/v3/projects/030d9dd7d96d4c80b4f0d037ad76ce58` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:41.206074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=030d9dd7d96d4c80b4f0d037ad76ce58)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:41.208101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:41.254379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030d9dd7d96d4c80b4f0d037ad76ce58', 'request_id': 'req-b81c6742-2376-40ce-9280-8febb1595fcc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:41.262493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030d9dd7d96d4c80b4f0d037ad76ce58', 'request_id': 'req-b81c6742-2376-40ce-9280-8febb1595fcc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:41.268448 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030d9dd7d96d4c80b4f0d037ad76ce58', 'request_id': 'req-b81c6742-2376-40ce-9280-8febb1595fcc'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:41.278618 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] The token cache is being invalidate because project 030d9dd7d96d4c80b4f0d037ad76ce58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:41.278905 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:41.279526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-b81c6742-2376-40ce-9280-8febb1595fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:41.281116 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1379/2757] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:41 2022] DELETE /identity/v3/projects/030d9dd7d96d4c80b4f0d037ad76ce58 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:43.840874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d937c-8e3c-4758-b43a-7ded55410383 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:43.842627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-fd0d937c-8e3c-4758-b43a-7ded55410383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:43.856171 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d937c-8e3c-4758-b43a-7ded55410383 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:43.911833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:43.912720 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:43.913000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:43.913274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] PATH_INFO: `/v3/users/3f21e98051414def863f35de7471c622` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:43.914481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f21e98051414def863f35de7471c622)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:43.916489 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:43.960953 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f21e98051414def863f35de7471c622'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:43.967648 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f21e98051414def863f35de7471c622'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:43.968350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f21e98051414def863f35de7471c622'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:43.968960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f21e98051414def863f35de7471c622'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:43.977431 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f21e98051414def863f35de7471c622'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:43.995008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1379/2758] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:43 2022] DELETE /identity/v3/users/3f21e98051414def863f35de7471c622 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:43.999663 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0888-0dd9-48f1-bc9e-f7e1dbed5cc5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:44.000133 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0888-0dd9-48f1-bc9e-f7e1dbed5cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:44.000248 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0888-0dd9-48f1-bc9e-f7e1dbed5cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:44.018362 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-cc3b0888-0dd9-48f1-bc9e-f7e1dbed5cc5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:44.019552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cc3b0888-0dd9-48f1-bc9e-f7e1dbed5cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:44.079114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1380/2759] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:04:44.088905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:44.090485 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:44.149532 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6678fa-dc52-4a3b-b55f-b60f49acfe68 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:44.153679 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d20b0-c6fb-4990-a130-2c412654e50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:44.154380 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d20b0-c6fb-4990-a130-2c412654e50e service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:44.154695 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d20b0-c6fb-4990-a130-2c412654e50e service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:44.154973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d20b0-c6fb-4990-a130-2c412654e50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:44.164327 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d20b0-c6fb-4990-a130-2c412654e50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:44.165793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d20b0-c6fb-4990-a130-2c412654e50e service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:44.175809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1380/2760] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:44.448006 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0888-0dd9-48f1-bc9e-f7e1dbed5cc5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:44.449568 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-cc3b0888-0dd9-48f1-bc9e-f7e1dbed5cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:44.466767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0888-0dd9-48f1-bc9e-f7e1dbed5cc5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:44.471784 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:44.472695 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:44.472947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:44.473330 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] PATH_INFO: `/v3/projects/c0d6da5dede84690af5ca9cb6f563eec` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:44.474419 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d6da5dede84690af5ca9cb6f563eec)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:44.476749 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:44.522190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d6da5dede84690af5ca9cb6f563eec', 'request_id': 'req-232a5dd1-834d-40ee-94ba-8dd08b762e61'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.531205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d6da5dede84690af5ca9cb6f563eec', 'request_id': 'req-232a5dd1-834d-40ee-94ba-8dd08b762e61'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.538651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d6da5dede84690af5ca9cb6f563eec', 'request_id': 'req-232a5dd1-834d-40ee-94ba-8dd08b762e61'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.549577 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] The token cache is being invalidate because project c0d6da5dede84690af5ca9cb6f563eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:44.549867 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.550593 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-232a5dd1-834d-40ee-94ba-8dd08b762e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.552239 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1381/2761] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:44 2022] DELETE /identity/v3/projects/c0d6da5dede84690af5ca9cb6f563eec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:44.556385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d20b0-c6fb-4990-a130-2c412654e50e service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:44.566035 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d20b0-c6fb-4990-a130-2c412654e50e service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:44.636498 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:44.637507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:44.637789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:44.638063 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] PATH_INFO: `/v3/users/c52a8741215148cdbf881ebf6444da3e` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:44.639394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52a8741215148cdbf881ebf6444da3e)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:44.641332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:44.690273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52a8741215148cdbf881ebf6444da3e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.698008 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52a8741215148cdbf881ebf6444da3e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.698777 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52a8741215148cdbf881ebf6444da3e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.699580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52a8741215148cdbf881ebf6444da3e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.708390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52a8741215148cdbf881ebf6444da3e'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:44.725094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1381/2762] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:04:44 2022] DELETE /identity/v3/users/c52a8741215148cdbf881ebf6444da3e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:04:44.960565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd9c1c-2300-4865-8a08-b4eb7bc0ea9b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:44.960846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd9c1c-2300-4865-8a08-b4eb7bc0ea9b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:44.961117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd9c1c-2300-4865-8a08-b4eb7bc0ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:44.979520 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-26fd9c1c-2300-4865-8a08-b4eb7bc0ea9b None None] MFA Rules not processed for user `45ce0414c1e84e52ad6dc6f840e4f658`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:44.980757 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-26fd9c1c-2300-4865-8a08-b4eb7bc0ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:45.014924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.024770 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:45.044832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1382/2763] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:04:45.088174 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e7bb1-711f-4ebe-8f55-492559c6d6b8 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.093094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.094134 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.094426 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.094698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] PATH_INFO: `/v3/projects/857436c0137347f18d63bddf2c49f48c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.095931 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=857436c0137347f18d63bddf2c49f48c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.097980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.143875 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857436c0137347f18d63bddf2c49f48c', 'request_id': 'req-ca614eff-c732-486d-8213-3c01e468e659'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:45.149781 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857436c0137347f18d63bddf2c49f48c', 'request_id': 'req-ca614eff-c732-486d-8213-3c01e468e659'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:45.158105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857436c0137347f18d63bddf2c49f48c', 'request_id': 'req-ca614eff-c732-486d-8213-3c01e468e659'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:45.168155 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] The token cache is being invalidate because project 857436c0137347f18d63bddf2c49f48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:04:45.168442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:45.169064 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ca614eff-c732-486d-8213-3c01e468e659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:04:45.170786 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1382/2764] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:04:45 2022] DELETE /identity/v3/projects/857436c0137347f18d63bddf2c49f48c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:04:45.176084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598c00-856d-4d3e-8bc1-f1d46b8b99b5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.176376 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598c00-856d-4d3e-8bc1-f1d46b8b99b5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.176653 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598c00-856d-4d3e-8bc1-f1d46b8b99b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.195407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-ca598c00-856d-4d3e-8bc1-f1d46b8b99b5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:45.196603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ca598c00-856d-4d3e-8bc1-f1d46b8b99b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:45.253432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1383/2765] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:45.262151 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfd154-eb81-4839-9bed-9b1dd7a9b3dc None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.262464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfd154-eb81-4839-9bed-9b1dd7a9b3dc None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.262740 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfd154-eb81-4839-9bed-9b1dd7a9b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.280800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-58bfd154-eb81-4839-9bed-9b1dd7a9b3dc None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:45.282001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-58bfd154-eb81-4839-9bed-9b1dd7a9b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:45.289924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1383/2766] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:45.294169 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca598c00-856d-4d3e-8bc1-f1d46b8b99b5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.303995 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca598c00-856d-4d3e-8bc1-f1d46b8b99b5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.308922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83630-2610-4b13-bb29-19136bec8125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.309625 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83630-2610-4b13-bb29-19136bec8125 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.309907 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83630-2610-4b13-bb29-19136bec8125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.310212 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83630-2610-4b13-bb29-19136bec8125 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.310946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83630-2610-4b13-bb29-19136bec8125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:04:45.311253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83630-2610-4b13-bb29-19136bec8125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.312847 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83630-2610-4b13-bb29-19136bec8125 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.329370 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1384/2767] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:04:45.330269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfd154-eb81-4839-9bed-9b1dd7a9b3dc None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.339634 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfd154-eb81-4839-9bed-9b1dd7a9b3dc None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.344584 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356c7c0-0205-495c-aa33-1e20993dc7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.345240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356c7c0-0205-495c-aa33-1e20993dc7bd admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.345560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356c7c0-0205-495c-aa33-1e20993dc7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.345818 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356c7c0-0205-495c-aa33-1e20993dc7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.346531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356c7c0-0205-495c-aa33-1e20993dc7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.348423 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356c7c0-0205-495c-aa33-1e20993dc7bd admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.375867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1384/2768] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:04:45 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:04:45.380692 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83630-2610-4b13-bb29-19136bec8125 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.391329 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83630-2610-4b13-bb29-19136bec8125 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.448649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd437c-12d2-4f1a-ba49-59fe2568cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.449318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd437c-12d2-4f1a-ba49-59fe2568cca9 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.449636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd437c-12d2-4f1a-ba49-59fe2568cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.449881 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd437c-12d2-4f1a-ba49-59fe2568cca9 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.450944 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd437c-12d2-4f1a-ba49-59fe2568cca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.452726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd437c-12d2-4f1a-ba49-59fe2568cca9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.474366 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1385/2769] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:04:45 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:45.478487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356c7c0-0205-495c-aa33-1e20993dc7bd admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.491390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356c7c0-0205-495c-aa33-1e20993dc7bd admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.496651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578e3d9-049b-44b0-ae08-f6c1e4b7e9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.497330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578e3d9-049b-44b0-ae08-f6c1e4b7e9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.497714 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578e3d9-049b-44b0-ae08-f6c1e4b7e9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.497993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578e3d9-049b-44b0-ae08-f6c1e4b7e9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.498827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578e3d9-049b-44b0-ae08-f6c1e4b7e9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.500480 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578e3d9-049b-44b0-ae08-f6c1e4b7e9e7 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.512138 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1385/2770] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:45.516482 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd437c-12d2-4f1a-ba49-59fe2568cca9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.526607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd437c-12d2-4f1a-ba49-59fe2568cca9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.531350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a10e55-8701-41a3-94bb-37910afb0ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.532055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a10e55-8701-41a3-94bb-37910afb0ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.532339 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a10e55-8701-41a3-94bb-37910afb0ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.532612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a10e55-8701-41a3-94bb-37910afb0ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.533374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a10e55-8701-41a3-94bb-37910afb0ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.534978 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a10e55-8701-41a3-94bb-37910afb0ff5 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.549226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1386/2771] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:45.552790 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578e3d9-049b-44b0-ae08-f6c1e4b7e9e7 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.564616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578e3d9-049b-44b0-ae08-f6c1e4b7e9e7 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.569688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e942a8-8238-4f8c-bae5-7b3234a7c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.570616 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e942a8-8238-4f8c-bae5-7b3234a7c364 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.570908 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e942a8-8238-4f8c-bae5-7b3234a7c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.571131 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e942a8-8238-4f8c-bae5-7b3234a7c364 admin admin] PATH_INFO: `/v3/projects/b42816e093a94cb5b30de0f0de54395c/users/583aaa9d3b8842b9997c14234adf1c24/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.586531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e942a8-8238-4f8c-bae5-7b3234a7c364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42816e093a94cb5b30de0f0de54395c, user_id=583aaa9d3b8842b9997c14234adf1c24, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.589265 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e942a8-8238-4f8c-bae5-7b3234a7c364 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.603570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1386/2772] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:45 2022] PUT /identity/v3/projects/b42816e093a94cb5b30de0f0de54395c/users/583aaa9d3b8842b9997c14234adf1c24/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:45.614190 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c349-8a69-422b-a594-113f71bc1714 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.614830 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c349-8a69-422b-a594-113f71bc1714 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.615111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c349-8a69-422b-a594-113f71bc1714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.644786 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-b5a6c349-8a69-422b-a594-113f71bc1714 None None] MFA Rules not processed for user `583aaa9d3b8842b9997c14234adf1c24`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:45.646101 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b5a6c349-8a69-422b-a594-113f71bc1714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:45.713144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1387/2773] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:45.717698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e942a8-8238-4f8c-bae5-7b3234a7c364 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.781637 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e942a8-8238-4f8c-bae5-7b3234a7c364 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.786462 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a89b7-0b94-4aba-9dd9-05199a7713c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.787136 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a89b7-0b94-4aba-9dd9-05199a7713c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.787414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a89b7-0b94-4aba-9dd9-05199a7713c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.787687 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a89b7-0b94-4aba-9dd9-05199a7713c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.788416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a89b7-0b94-4aba-9dd9-05199a7713c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.790441 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a89b7-0b94-4aba-9dd9-05199a7713c8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.819450 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1387/2774] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:04:45 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:45.823476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6c349-8a69-422b-a594-113f71bc1714 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.834471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6c349-8a69-422b-a594-113f71bc1714 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.898938 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8391f-fc0d-4215-99c6-184b8b4ea3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.899816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8391f-fc0d-4215-99c6-184b8b4ea3ee admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.900217 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8391f-fc0d-4215-99c6-184b8b4ea3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.900630 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8391f-fc0d-4215-99c6-184b8b4ea3ee admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.901765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8391f-fc0d-4215-99c6-184b8b4ea3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.904607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8391f-fc0d-4215-99c6-184b8b4ea3ee admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.926033 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1388/2775] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:04:45 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:04:45.931579 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a89b7-0b94-4aba-9dd9-05199a7713c8 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.943129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a89b7-0b94-4aba-9dd9-05199a7713c8 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.948382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff50f9-8aa6-4f3f-abf3-7c6f91502ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.949135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff50f9-8aa6-4f3f-abf3-7c6f91502ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.949527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff50f9-8aa6-4f3f-abf3-7c6f91502ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.949872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff50f9-8aa6-4f3f-abf3-7c6f91502ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:45.950690 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff50f9-8aa6-4f3f-abf3-7c6f91502ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:45.952442 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff50f9-8aa6-4f3f-abf3-7c6f91502ee8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:45.965336 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1388/2776] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:04:45.970242 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8391f-fc0d-4215-99c6-184b8b4ea3ee admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:45.982716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8391f-fc0d-4215-99c6-184b8b4ea3ee admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:45.988179 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23d52b-2592-465f-b760-cf76a90443b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:45.989581 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d52b-2592-465f-b760-cf76a90443b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:45.990010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d52b-2592-465f-b760-cf76a90443b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:45.990444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d52b-2592-465f-b760-cf76a90443b3 admin admin] PATH_INFO: `/v3/projects/b8f5b9a79d33457ebbcf9a137fd1813d/users/e0a672d2d7f9439a83324a28ddf56e97/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:46.006754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23d52b-2592-465f-b760-cf76a90443b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f5b9a79d33457ebbcf9a137fd1813d, user_id=e0a672d2d7f9439a83324a28ddf56e97, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:46.009471 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23d52b-2592-465f-b760-cf76a90443b3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:46.028145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1389/2777] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:45 2022] PUT /identity/v3/projects/b8f5b9a79d33457ebbcf9a137fd1813d/users/e0a672d2d7f9439a83324a28ddf56e97/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:04:46.029428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff50f9-8aa6-4f3f-abf3-7c6f91502ee8 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:46.041314 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff50f9-8aa6-4f3f-abf3-7c6f91502ee8 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:46.108244 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4ebe8-0b74-4afa-9d55-5b8942b3f922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:46.108932 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ebe8-0b74-4afa-9d55-5b8942b3f922 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:46.109277 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ebe8-0b74-4afa-9d55-5b8942b3f922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:46.110014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4ebe8-0b74-4afa-9d55-5b8942b3f922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:46.110571 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4ebe8-0b74-4afa-9d55-5b8942b3f922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:46.112285 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4ebe8-0b74-4afa-9d55-5b8942b3f922 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:46.127388 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1389/2778] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:04:46.128996 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23d52b-2592-465f-b760-cf76a90443b3 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:46.139286 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23d52b-2592-465f-b760-cf76a90443b3 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:46.144059 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691983e7-35f1-4d3d-aa53-cc35883a539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:46.144956 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691983e7-35f1-4d3d-aa53-cc35883a539b admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:46.145233 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691983e7-35f1-4d3d-aa53-cc35883a539b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:46.145530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691983e7-35f1-4d3d-aa53-cc35883a539b admin admin] PATH_INFO: `/v3/projects/b8f5b9a79d33457ebbcf9a137fd1813d/users/e0a672d2d7f9439a83324a28ddf56e97/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:46.147747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691983e7-35f1-4d3d-aa53-cc35883a539b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f5b9a79d33457ebbcf9a137fd1813d, user_id=e0a672d2d7f9439a83324a28ddf56e97, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:46.150712 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691983e7-35f1-4d3d-aa53-cc35883a539b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:46.172027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1390/2779] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:04:46 2022] PUT /identity/v3/projects/b8f5b9a79d33457ebbcf9a137fd1813d/users/e0a672d2d7f9439a83324a28ddf56e97/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:04:46.172670 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5521b-1458-47d7-bf69-87a73a713452 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:46.172956 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5521b-1458-47d7-bf69-87a73a713452 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:46.173229 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5521b-1458-47d7-bf69-87a73a713452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:46.201869 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-cda5521b-1458-47d7-bf69-87a73a713452 None None] MFA Rules not processed for user `e0a672d2d7f9439a83324a28ddf56e97`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:04:46.203201 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cda5521b-1458-47d7-bf69-87a73a713452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:46.288615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1390/2780] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:04:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:04:46.300318 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691983e7-35f1-4d3d-aa53-cc35883a539b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:46.302065 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-691983e7-35f1-4d3d-aa53-cc35883a539b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:04:46.362369 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691983e7-35f1-4d3d-aa53-cc35883a539b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:46.366461 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4b4cd-2e93-43b4-b5f0-647dc31ef372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:46.367114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4b4cd-2e93-43b4-b5f0-647dc31ef372 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:46.367397 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4b4cd-2e93-43b4-b5f0-647dc31ef372 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:46.367674 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4b4cd-2e93-43b4-b5f0-647dc31ef372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:46.429760 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4b4cd-2e93-43b4-b5f0-647dc31ef372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:46.431251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4b4cd-2e93-43b4-b5f0-647dc31ef372 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:46.444649 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1391/2781] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:04:51.068708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5521b-1458-47d7-bf69-87a73a713452 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:04:51.078993 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5521b-1458-47d7-bf69-87a73a713452 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:04:51.083499 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2691d9-6670-475e-aa7f-039309a08f64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:04:51.084232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2691d9-6670-475e-aa7f-039309a08f64 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:04:51.084517 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2691d9-6670-475e-aa7f-039309a08f64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:04:51.084789 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2691d9-6670-475e-aa7f-039309a08f64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:04:51.096065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2691d9-6670-475e-aa7f-039309a08f64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:04:51.098236 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2691d9-6670-475e-aa7f-039309a08f64 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:04:51.109127 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1391/2782] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:04:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:02.276714 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4b4cd-2e93-43b4-b5f0-647dc31ef372 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:02.278399 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-b3b4b4cd-2e93-43b4-b5f0-647dc31ef372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:02.356896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4b4cd-2e93-43b4-b5f0-647dc31ef372 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:02.363440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6eaf63f68734bdd938aa0ea7d0c4441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:02.364476 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:02.364758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:02.365049 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:02.366882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:02.379888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:02.381660 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:02.396333 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1392/2783] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:05.509379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5acb4-8f15-4ffa-8513-536e2f9b00d7 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:05.509946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5acb4-8f15-4ffa-8513-536e2f9b00d7 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:05.509946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5acb4-8f15-4ffa-8513-536e2f9b00d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:05.529528 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-19a5acb4-8f15-4ffa-8513-536e2f9b00d7 None None] MFA Rules not processed for user `60a62451b6cc43c9a275a7d7c06bf4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:05.530751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-19a5acb4-8f15-4ffa-8513-536e2f9b00d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:05.593583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1392/2784] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:05.829381 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:05.830904 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:05.889953 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb787c-b1d0-4b0d-b5cf-4346f574ac71 service placement] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:05.894296 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb644206-46c9-4ff6-acf9-6a5b8e08303c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:05.894912 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb644206-46c9-4ff6-acf9-6a5b8e08303c service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:05.895197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb644206-46c9-4ff6-acf9-6a5b8e08303c service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:05.895472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb644206-46c9-4ff6-acf9-6a5b8e08303c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:05.897526 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fb644206-46c9-4ff6-acf9-6a5b8e08303c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:05.907686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb644206-46c9-4ff6-acf9-6a5b8e08303c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:05.909234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb644206-46c9-4ff6-acf9-6a5b8e08303c service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:05.917572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1393/2785] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:15.812811 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5acb4-8f15-4ffa-8513-536e2f9b00d7 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:15.823316 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5acb4-8f15-4ffa-8513-536e2f9b00d7 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:15.827080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ca844-3eb4-4397-9a31-bbd6c59c90fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:15.827850 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ca844-3eb4-4397-9a31-bbd6c59c90fb service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:15.828125 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ca844-3eb4-4397-9a31-bbd6c59c90fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:15.828396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ca844-3eb4-4397-9a31-bbd6c59c90fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:15.830169 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-405ca844-3eb4-4397-9a31-bbd6c59c90fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:15.896981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ca844-3eb4-4397-9a31-bbd6c59c90fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:15.898367 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ca844-3eb4-4397-9a31-bbd6c59c90fb service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:15.907961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1393/2786] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:18.137679 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb644206-46c9-4ff6-acf9-6a5b8e08303c service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:18.209022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb644206-46c9-4ff6-acf9-6a5b8e08303c service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:18.213790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:18.214670 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:18.214962 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:18.215229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] PATH_INFO: `/v3/users/583aaa9d3b8842b9997c14234adf1c24` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:18.216686 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583aaa9d3b8842b9997c14234adf1c24)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:18.218675 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:18.275345 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583aaa9d3b8842b9997c14234adf1c24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:18.282845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583aaa9d3b8842b9997c14234adf1c24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:18.284200 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583aaa9d3b8842b9997c14234adf1c24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:18.298255 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583aaa9d3b8842b9997c14234adf1c24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:18.308098 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583aaa9d3b8842b9997c14234adf1c24'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:18.330666 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1394/2787] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:05:18 2022] DELETE /identity/v3/users/583aaa9d3b8842b9997c14234adf1c24 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:18.332640 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f32d9-def0-4622-829b-f4ee36815c8b None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:18.333238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f32d9-def0-4622-829b-f4ee36815c8b None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:18.333238 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f32d9-def0-4622-829b-f4ee36815c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:18.351717 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-152f32d9-def0-4622-829b-f4ee36815c8b None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:18.352730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-152f32d9-def0-4622-829b-f4ee36815c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:18.419282 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1394/2788] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:18.429402 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:18.430865 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:18.496747 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2d19-d191-4088-a940-aa9837fc4ca9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:18.501166 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d43a-48b5-42a3-8076-14eab383990e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:18.501966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d43a-48b5-42a3-8076-14eab383990e service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:18.502341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d43a-48b5-42a3-8076-14eab383990e service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:18.502715 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d43a-48b5-42a3-8076-14eab383990e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:18.513213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471d43a-48b5-42a3-8076-14eab383990e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:18.514874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471d43a-48b5-42a3-8076-14eab383990e service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:18.525726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1395/2789] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:18.914621 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f32d9-def0-4622-829b-f4ee36815c8b None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:18.916198 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-152f32d9-def0-4622-829b-f4ee36815c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:18.931084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f32d9-def0-4622-829b-f4ee36815c8b None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:18.936544 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:18.937709 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:18.938200 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:18.938656 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] PATH_INFO: `/v3/projects/b42816e093a94cb5b30de0f0de54395c` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:18.940077 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42816e093a94cb5b30de0f0de54395c)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:18.943075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:18.993921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42816e093a94cb5b30de0f0de54395c', 'request_id': 'req-1b72e5ba-3046-40a2-80a9-982881a26973'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.000059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42816e093a94cb5b30de0f0de54395c', 'request_id': 'req-1b72e5ba-3046-40a2-80a9-982881a26973'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.009667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42816e093a94cb5b30de0f0de54395c', 'request_id': 'req-1b72e5ba-3046-40a2-80a9-982881a26973'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.020030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] The token cache is being invalidate because project b42816e093a94cb5b30de0f0de54395c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:05:19.020315 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.020922 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.022657 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1395/2790] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:05:18 2022] DELETE /identity/v3/projects/b42816e093a94cb5b30de0f0de54395c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:19.026804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d43a-48b5-42a3-8076-14eab383990e service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:19.036565 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d43a-48b5-42a3-8076-14eab383990e service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:19.091703 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:19.092504 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:19.092783 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:19.093053 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] PATH_INFO: `/v3/users/e0a672d2d7f9439a83324a28ddf56e97` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:19.094276 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a672d2d7f9439a83324a28ddf56e97)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:19.096205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:19.148068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a672d2d7f9439a83324a28ddf56e97'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.155443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a672d2d7f9439a83324a28ddf56e97'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.156193 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a672d2d7f9439a83324a28ddf56e97'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.156887 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a672d2d7f9439a83324a28ddf56e97'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.166633 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6670425f-095f-48f8-bd0c-767e1fe8d33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a672d2d7f9439a83324a28ddf56e97'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.186590 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1396/2791] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:05:19 2022] DELETE /identity/v3/users/e0a672d2d7f9439a83324a28ddf56e97 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:19.459319 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:19.460877 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:19.474698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72e5ba-3046-40a2-80a9-982881a26973 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:19.532440 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:19.533350 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:19.533636 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:19.533905 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] PATH_INFO: `/v3/projects/b8f5b9a79d33457ebbcf9a137fd1813d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:19.535135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f5b9a79d33457ebbcf9a137fd1813d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:19.537015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:19.580312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f5b9a79d33457ebbcf9a137fd1813d', 'request_id': 'req-70efafde-b323-4ade-a392-8945b0433816'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.586866 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f5b9a79d33457ebbcf9a137fd1813d', 'request_id': 'req-70efafde-b323-4ade-a392-8945b0433816'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.596514 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f5b9a79d33457ebbcf9a137fd1813d', 'request_id': 'req-70efafde-b323-4ade-a392-8945b0433816'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.606638 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] The token cache is being invalidate because project b8f5b9a79d33457ebbcf9a137fd1813d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:05:19.606921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.607586 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-70efafde-b323-4ade-a392-8945b0433816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:19.609076 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1396/2792] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:05:19 2022] DELETE /identity/v3/projects/b8f5b9a79d33457ebbcf9a137fd1813d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:19.615700 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702385d-a590-43c0-9e77-a62464f31f67 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:19.615980 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702385d-a590-43c0-9e77-a62464f31f67 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:19.616251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702385d-a590-43c0-9e77-a62464f31f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:19.633802 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-9702385d-a590-43c0-9e77-a62464f31f67 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:19.634922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-9702385d-a590-43c0-9e77-a62464f31f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:19.691736 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1397/2793] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:05:19.699898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2a56a-c7fd-4432-8646-e580104b7d80 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:19.700185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2a56a-c7fd-4432-8646-e580104b7d80 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:19.700460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2a56a-c7fd-4432-8646-e580104b7d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:19.722056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-f4d2a56a-c7fd-4432-8646-e580104b7d80 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:19.723282 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-f4d2a56a-c7fd-4432-8646-e580104b7d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:19.732412 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1397/2794] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:19.736592 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702385d-a590-43c0-9e77-a62464f31f67 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:19.747096 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702385d-a590-43c0-9e77-a62464f31f67 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:19.752914 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19184a99-c961-4da1-8b2e-7a249ac91b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:19.753627 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184a99-c961-4da1-8b2e-7a249ac91b2d admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:19.753884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184a99-c961-4da1-8b2e-7a249ac91b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:19.754157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184a99-c961-4da1-8b2e-7a249ac91b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:19.754884 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19184a99-c961-4da1-8b2e-7a249ac91b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:05:19.755191 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19184a99-c961-4da1-8b2e-7a249ac91b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:19.756787 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19184a99-c961-4da1-8b2e-7a249ac91b2d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:19.768462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1398/2795] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:05:19.774079 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2a56a-c7fd-4432-8646-e580104b7d80 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:19.784907 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2a56a-c7fd-4432-8646-e580104b7d80 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:19.793895 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3b50-7aab-4b7d-8cbf-057dfbc0a754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:19.794759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3b50-7aab-4b7d-8cbf-057dfbc0a754 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:19.795047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3b50-7aab-4b7d-8cbf-057dfbc0a754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:19.795309 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3b50-7aab-4b7d-8cbf-057dfbc0a754 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:19.796266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db3b50-7aab-4b7d-8cbf-057dfbc0a754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:19.799088 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db3b50-7aab-4b7d-8cbf-057dfbc0a754 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:19.829718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1398/2796] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:05:19 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:19.834129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19184a99-c961-4da1-8b2e-7a249ac91b2d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:19.844538 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19184a99-c961-4da1-8b2e-7a249ac91b2d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:19.909444 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d51c-28bf-4752-9383-d0b32b327a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:19.910138 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d51c-28bf-4752-9383-d0b32b327a78 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:19.911094 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d51c-28bf-4752-9383-d0b32b327a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:19.911378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d51c-28bf-4752-9383-d0b32b327a78 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:19.912095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5d51c-28bf-4752-9383-d0b32b327a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:19.914232 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5d51c-28bf-4752-9383-d0b32b327a78 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:19.938221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1399/2797] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:05:19 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:19.942593 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3b50-7aab-4b7d-8cbf-057dfbc0a754 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:19.961793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3b50-7aab-4b7d-8cbf-057dfbc0a754 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:19.970307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c96e1-b335-433e-9c5b-7068791b0b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:19.970979 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c96e1-b335-433e-9c5b-7068791b0b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:19.971255 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c96e1-b335-433e-9c5b-7068791b0b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:19.971554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c96e1-b335-433e-9c5b-7068791b0b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:19.972400 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c96e1-b335-433e-9c5b-7068791b0b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:19.974040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c96e1-b335-433e-9c5b-7068791b0b00 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:19.984930 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1399/2798] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:19.989704 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d51c-28bf-4752-9383-d0b32b327a78 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:20.001016 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d51c-28bf-4752-9383-d0b32b327a78 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:20.007043 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb3673-6aaa-43b9-bd6b-6a1f3b0ea897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:20.007709 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3673-6aaa-43b9-bd6b-6a1f3b0ea897 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.007990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3673-6aaa-43b9-bd6b-6a1f3b0ea897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.008262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb3673-6aaa-43b9-bd6b-6a1f3b0ea897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.008974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb3673-6aaa-43b9-bd6b-6a1f3b0ea897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:20.010619 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb3673-6aaa-43b9-bd6b-6a1f3b0ea897 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:20.020808 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1400/2799] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:20.025445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c96e1-b335-433e-9c5b-7068791b0b00 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:20.038522 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c96e1-b335-433e-9c5b-7068791b0b00 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:20.043960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a57a09-3f8f-429c-b821-10be045de20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:20.044859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a57a09-3f8f-429c-b821-10be045de20f admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.045123 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a57a09-3f8f-429c-b821-10be045de20f admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.045430 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a57a09-3f8f-429c-b821-10be045de20f admin admin] PATH_INFO: `/v3/projects/9abc7ed23d804b9ca2475d52e4ad7376/users/232391920e32431c9f8e338af56139be/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.060121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a57a09-3f8f-429c-b821-10be045de20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abc7ed23d804b9ca2475d52e4ad7376, user_id=232391920e32431c9f8e338af56139be, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:20.062946 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a57a09-3f8f-429c-b821-10be045de20f admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:20.077934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1400/2800] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:05:20 2022] PUT /identity/v3/projects/9abc7ed23d804b9ca2475d52e4ad7376/users/232391920e32431c9f8e338af56139be/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:20.088205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec84fc-9d23-4cef-9734-b2e7442ab73f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.088497 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec84fc-9d23-4cef-9734-b2e7442ab73f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.088771 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec84fc-9d23-4cef-9734-b2e7442ab73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.115095 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-83ec84fc-9d23-4cef-9734-b2e7442ab73f None None] MFA Rules not processed for user `232391920e32431c9f8e338af56139be`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:20.116283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-83ec84fc-9d23-4cef-9734-b2e7442ab73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:20.179726 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1401/2801] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:20.184583 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a57a09-3f8f-429c-b821-10be045de20f admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:20.263232 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a57a09-3f8f-429c-b821-10be045de20f admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:20.271069 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3ce36-f7ac-4be5-863f-61ed154d4676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:20.271745 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ce36-f7ac-4be5-863f-61ed154d4676 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.272034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ce36-f7ac-4be5-863f-61ed154d4676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.272335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ce36-f7ac-4be5-863f-61ed154d4676 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.273030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3ce36-f7ac-4be5-863f-61ed154d4676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:20.274981 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3ce36-f7ac-4be5-863f-61ed154d4676 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:20.303704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1401/2802] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:05:20 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:20.308029 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec84fc-9d23-4cef-9734-b2e7442ab73f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:20.318635 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec84fc-9d23-4cef-9734-b2e7442ab73f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:20.377039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a85f51-01f8-4152-81d3-1159315181c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:20.377886 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a85f51-01f8-4152-81d3-1159315181c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.378201 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a85f51-01f8-4152-81d3-1159315181c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.378529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a85f51-01f8-4152-81d3-1159315181c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.379326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a85f51-01f8-4152-81d3-1159315181c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:20.381415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a85f51-01f8-4152-81d3-1159315181c8 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:20.401594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1402/2803] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:05:20 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:20.405678 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3ce36-f7ac-4be5-863f-61ed154d4676 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:20.415632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3ce36-f7ac-4be5-863f-61ed154d4676 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:20.420635 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c39d1-3e1d-4f69-bc6f-a5a4708e7135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:20.421357 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c39d1-3e1d-4f69-bc6f-a5a4708e7135 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.421635 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c39d1-3e1d-4f69-bc6f-a5a4708e7135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.421919 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c39d1-3e1d-4f69-bc6f-a5a4708e7135 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.422645 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c39d1-3e1d-4f69-bc6f-a5a4708e7135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:20.424394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c39d1-3e1d-4f69-bc6f-a5a4708e7135 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:20.436477 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1402/2804] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:20.440819 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a85f51-01f8-4152-81d3-1159315181c8 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:20.450927 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a85f51-01f8-4152-81d3-1159315181c8 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:20.455623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22621be-e35c-402b-a00d-9663c1cc201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:20.456569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22621be-e35c-402b-a00d-9663c1cc201d admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.456845 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22621be-e35c-402b-a00d-9663c1cc201d admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.457115 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22621be-e35c-402b-a00d-9663c1cc201d admin admin] PATH_INFO: `/v3/projects/2ebe438165ca48db97edf8b42a1b383d/users/7a9c2b2de7004ef0b1708026eb011c31/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.471694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22621be-e35c-402b-a00d-9663c1cc201d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebe438165ca48db97edf8b42a1b383d, user_id=7a9c2b2de7004ef0b1708026eb011c31, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:20.474418 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22621be-e35c-402b-a00d-9663c1cc201d admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:20.489792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1403/2805] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:05:20 2022] PUT /identity/v3/projects/2ebe438165ca48db97edf8b42a1b383d/users/7a9c2b2de7004ef0b1708026eb011c31/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:20.494034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c39d1-3e1d-4f69-bc6f-a5a4708e7135 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:20.504025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c39d1-3e1d-4f69-bc6f-a5a4708e7135 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:20.557965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a5b4e-8be0-475b-a4f0-65990db2394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:20.558632 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a5b4e-8be0-475b-a4f0-65990db2394b admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.558910 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a5b4e-8be0-475b-a4f0-65990db2394b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.559177 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a5b4e-8be0-475b-a4f0-65990db2394b admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.559901 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a5b4e-8be0-475b-a4f0-65990db2394b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:20.561491 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a5b4e-8be0-475b-a4f0-65990db2394b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:20.571205 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1403/2806] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:20.575601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22621be-e35c-402b-a00d-9663c1cc201d admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:20.586162 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22621be-e35c-402b-a00d-9663c1cc201d admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:20.591093 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79453f07-6dc5-4beb-8298-f260b6387588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:20.591984 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453f07-6dc5-4beb-8298-f260b6387588 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.592263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453f07-6dc5-4beb-8298-f260b6387588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.592539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79453f07-6dc5-4beb-8298-f260b6387588 admin admin] PATH_INFO: `/v3/projects/2ebe438165ca48db97edf8b42a1b383d/users/7a9c2b2de7004ef0b1708026eb011c31/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.594510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79453f07-6dc5-4beb-8298-f260b6387588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebe438165ca48db97edf8b42a1b383d, user_id=7a9c2b2de7004ef0b1708026eb011c31, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:20.597146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79453f07-6dc5-4beb-8298-f260b6387588 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:20.607764 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1404/2807] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:05:20 2022] PUT /identity/v3/projects/2ebe438165ca48db97edf8b42a1b383d/users/7a9c2b2de7004ef0b1708026eb011c31/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:20.619356 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e241-f38f-4682-9826-bfffce4dd3df None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.619658 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e241-f38f-4682-9826-bfffce4dd3df None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.619921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e241-f38f-4682-9826-bfffce4dd3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.646141 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-1b64e241-f38f-4682-9826-bfffce4dd3df None None] MFA Rules not processed for user `7a9c2b2de7004ef0b1708026eb011c31`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:20.647346 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1b64e241-f38f-4682-9826-bfffce4dd3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:20.713264 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1404/2808] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:20.724031 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79453f07-6dc5-4beb-8298-f260b6387588 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:20.725799 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-79453f07-6dc5-4beb-8298-f260b6387588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:20.781629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79453f07-6dc5-4beb-8298-f260b6387588 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:20.787010 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26c60c-9654-4bcc-8666-0f7deb76db81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:20.787873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26c60c-9654-4bcc-8666-0f7deb76db81 service cinder] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:20.788153 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26c60c-9654-4bcc-8666-0f7deb76db81 service cinder] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:20.788425 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26c60c-9654-4bcc-8666-0f7deb76db81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:20.854240 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26c60c-9654-4bcc-8666-0f7deb76db81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:20.855724 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26c60c-9654-4bcc-8666-0f7deb76db81 service cinder] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:20.865916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1405/2809] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:25.075257 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e241-f38f-4682-9826-bfffce4dd3df None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:25.076793 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-1b64e241-f38f-4682-9826-bfffce4dd3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:25.089882 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e241-f38f-4682-9826-bfffce4dd3df None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:25.094351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0e452-0a93-4b21-b1f1-040dcecdaa13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:25.095001 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0e452-0a93-4b21-b1f1-040dcecdaa13 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:25.095289 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0e452-0a93-4b21-b1f1-040dcecdaa13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:25.095559 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0e452-0a93-4b21-b1f1-040dcecdaa13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:25.105250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0e452-0a93-4b21-b1f1-040dcecdaa13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:25.106724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0e452-0a93-4b21-b1f1-040dcecdaa13 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:25.117231 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1405/2810] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:32.308300 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26c60c-9654-4bcc-8666-0f7deb76db81 service cinder] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:32.374972 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26c60c-9654-4bcc-8666-0f7deb76db81 service cinder] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:32.380252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:32.381119 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:32.381421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:32.381691 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] PATH_INFO: `/v3/users/232391920e32431c9f8e338af56139be` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:32.382916 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=232391920e32431c9f8e338af56139be)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:32.384842 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:32.445019 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232391920e32431c9f8e338af56139be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:32.453432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232391920e32431c9f8e338af56139be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:32.454170 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232391920e32431c9f8e338af56139be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:32.454829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232391920e32431c9f8e338af56139be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:32.463803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232391920e32431c9f8e338af56139be'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:32.481347 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1406/2811] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:05:32 2022] DELETE /identity/v3/users/232391920e32431c9f8e338af56139be => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:32.486085 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f07de-4572-4eeb-b8c4-676e6f0392ff None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:32.486689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f07de-4572-4eeb-b8c4-676e6f0392ff None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:32.486689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f07de-4572-4eeb-b8c4-676e6f0392ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:32.505381 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-826f07de-4572-4eeb-b8c4-676e6f0392ff None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:32.506603 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-826f07de-4572-4eeb-b8c4-676e6f0392ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:32.570384 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1406/2812] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:32.580877 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:32.582918 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:32.647536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb822f1a-e6a7-42f3-bd33-b2e3b1036374 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:32.652284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d47b9-e455-4530-8a15-28e3d8ae3301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:32.652922 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d47b9-e455-4530-8a15-28e3d8ae3301 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:32.653244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d47b9-e455-4530-8a15-28e3d8ae3301 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:32.653550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d47b9-e455-4530-8a15-28e3d8ae3301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:32.662868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d47b9-e455-4530-8a15-28e3d8ae3301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:32.664299 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d47b9-e455-4530-8a15-28e3d8ae3301 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:32.673754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1407/2813] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:32.956196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f07de-4572-4eeb-b8c4-676e6f0392ff None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:32.957667 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-826f07de-4572-4eeb-b8c4-676e6f0392ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:32.969638 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f07de-4572-4eeb-b8c4-676e6f0392ff None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:32.974639 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:32.975509 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:32.975787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:32.976057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] PATH_INFO: `/v3/projects/9abc7ed23d804b9ca2475d52e4ad7376` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:32.977230 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abc7ed23d804b9ca2475d52e4ad7376)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:32.979173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:33.026251 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abc7ed23d804b9ca2475d52e4ad7376', 'request_id': 'req-ac4dcf86-6026-412e-a59b-2295727da8bf'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.032306 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abc7ed23d804b9ca2475d52e4ad7376', 'request_id': 'req-ac4dcf86-6026-412e-a59b-2295727da8bf'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.040424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abc7ed23d804b9ca2475d52e4ad7376', 'request_id': 'req-ac4dcf86-6026-412e-a59b-2295727da8bf'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.050561 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] The token cache is being invalidate because project 9abc7ed23d804b9ca2475d52e4ad7376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:05:33.050849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.051489 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.053047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1407/2814] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:05:32 2022] DELETE /identity/v3/projects/9abc7ed23d804b9ca2475d52e4ad7376 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:33.057106 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d47b9-e455-4530-8a15-28e3d8ae3301 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:33.066542 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d47b9-e455-4530-8a15-28e3d8ae3301 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:33.123939 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:33.124739 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:33.125017 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:33.125258 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] PATH_INFO: `/v3/users/7a9c2b2de7004ef0b1708026eb011c31` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:33.126553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9c2b2de7004ef0b1708026eb011c31)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:33.128472 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:33.176035 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9c2b2de7004ef0b1708026eb011c31'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.182991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9c2b2de7004ef0b1708026eb011c31'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.183742 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9c2b2de7004ef0b1708026eb011c31'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.184451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9c2b2de7004ef0b1708026eb011c31'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.193548 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2095fe44-431b-4401-a1fd-3e20a6b5cd92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9c2b2de7004ef0b1708026eb011c31'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.211172 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1408/2815] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:05:33 2022] DELETE /identity/v3/users/7a9c2b2de7004ef0b1708026eb011c31 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:33.502331 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:33.503871 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:33.517248 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dcf86-6026-412e-a59b-2295727da8bf admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:33.572921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:33.573830 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:33.574116 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:33.574383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] PATH_INFO: `/v3/projects/2ebe438165ca48db97edf8b42a1b383d` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:33.575590 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebe438165ca48db97edf8b42a1b383d)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:33.577542 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:33.634269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebe438165ca48db97edf8b42a1b383d', 'request_id': 'req-d0b9266d-17a9-4b1d-a224-314d07d1bcff'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.641403 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebe438165ca48db97edf8b42a1b383d', 'request_id': 'req-d0b9266d-17a9-4b1d-a224-314d07d1bcff'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.650698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebe438165ca48db97edf8b42a1b383d', 'request_id': 'req-d0b9266d-17a9-4b1d-a224-314d07d1bcff'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.660791 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] The token cache is being invalidate because project 2ebe438165ca48db97edf8b42a1b383d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:05:33.661075 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.661801 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-d0b9266d-17a9-4b1d-a224-314d07d1bcff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:33.663420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1408/2816] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:05:33 2022] DELETE /identity/v3/projects/2ebe438165ca48db97edf8b42a1b383d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:33.669584 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b583b-5a21-4a04-8120-49d6c3e09db5 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:33.670077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b583b-5a21-4a04-8120-49d6c3e09db5 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:33.670077 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b583b-5a21-4a04-8120-49d6c3e09db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:33.687282 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-758b583b-5a21-4a04-8120-49d6c3e09db5 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:33.688493 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-758b583b-5a21-4a04-8120-49d6c3e09db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:33.757451 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1409/2817] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:33.767433 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffde3a-53fa-441b-8486-35cd901aed7e None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:33.767722 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffde3a-53fa-441b-8486-35cd901aed7e None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:33.767992 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffde3a-53fa-441b-8486-35cd901aed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:33.786424 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-82ffde3a-53fa-441b-8486-35cd901aed7e None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:33.787625 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-82ffde3a-53fa-441b-8486-35cd901aed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:33.796348 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1409/2818] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:05:33.802007 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b583b-5a21-4a04-8120-49d6c3e09db5 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:33.812579 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b583b-5a21-4a04-8120-49d6c3e09db5 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:33.818226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba2726-4e12-4686-a3ff-159d307d18d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:33.818874 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba2726-4e12-4686-a3ff-159d307d18d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:33.819155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba2726-4e12-4686-a3ff-159d307d18d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:33.819424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba2726-4e12-4686-a3ff-159d307d18d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:33.820144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba2726-4e12-4686-a3ff-159d307d18d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:05:33.820447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba2726-4e12-4686-a3ff-159d307d18d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:33.822254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba2726-4e12-4686-a3ff-159d307d18d9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:33.834168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1410/2819] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:05:33.838530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffde3a-53fa-441b-8486-35cd901aed7e None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:33.847758 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffde3a-53fa-441b-8486-35cd901aed7e None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:33.852859 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fd544-4d58-4d95-ab42-6f8b31de26f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:33.853570 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fd544-4d58-4d95-ab42-6f8b31de26f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:33.853848 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fd544-4d58-4d95-ab42-6f8b31de26f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:33.854121 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fd544-4d58-4d95-ab42-6f8b31de26f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:33.854879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fd544-4d58-4d95-ab42-6f8b31de26f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:33.856759 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fd544-4d58-4d95-ab42-6f8b31de26f8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:33.885062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1410/2820] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:05:33 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:05:33.889210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba2726-4e12-4686-a3ff-159d307d18d9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:33.899901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba2726-4e12-4686-a3ff-159d307d18d9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:33.957882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5602b-40d9-4c2a-87f9-08cdc01d09e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:33.958600 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5602b-40d9-4c2a-87f9-08cdc01d09e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:33.958906 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5602b-40d9-4c2a-87f9-08cdc01d09e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:33.959203 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5602b-40d9-4c2a-87f9-08cdc01d09e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:33.959880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5602b-40d9-4c2a-87f9-08cdc01d09e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:33.961829 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5602b-40d9-4c2a-87f9-08cdc01d09e9 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:33.981935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1411/2821] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:05:33 2022] POST /identity/v3/users => generated 280 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:33.986161 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fd544-4d58-4d95-ab42-6f8b31de26f8 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:33.996675 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fd544-4d58-4d95-ab42-6f8b31de26f8 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:34.001969 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954837b8-cb6f-4db1-b8df-c9ee84b69289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:34.002659 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954837b8-cb6f-4db1-b8df-c9ee84b69289 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:34.002934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954837b8-cb6f-4db1-b8df-c9ee84b69289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:34.003220 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954837b8-cb6f-4db1-b8df-c9ee84b69289 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:34.003980 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954837b8-cb6f-4db1-b8df-c9ee84b69289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:34.005594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954837b8-cb6f-4db1-b8df-c9ee84b69289 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:34.015771 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1411/2822] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 19:05:34.019536 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5602b-40d9-4c2a-87f9-08cdc01d09e9 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:34.029251 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5602b-40d9-4c2a-87f9-08cdc01d09e9 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:34.033883 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85358a-2b78-4ae1-9125-90a44d2fbbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:34.034527 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85358a-2b78-4ae1-9125-90a44d2fbbaa admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:34.034806 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85358a-2b78-4ae1-9125-90a44d2fbbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:34.035076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85358a-2b78-4ae1-9125-90a44d2fbbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:34.035801 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85358a-2b78-4ae1-9125-90a44d2fbbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:34.037409 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85358a-2b78-4ae1-9125-90a44d2fbbaa admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:34.047157 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1412/2823] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:34.051080 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954837b8-cb6f-4db1-b8df-c9ee84b69289 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:34.061513 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954837b8-cb6f-4db1-b8df-c9ee84b69289 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:34.067530 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818d41e-9254-436f-87f0-f6a5edb1a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:34.068420 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818d41e-9254-436f-87f0-f6a5edb1a138 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:34.068697 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818d41e-9254-436f-87f0-f6a5edb1a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:34.068971 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818d41e-9254-436f-87f0-f6a5edb1a138 admin admin] PATH_INFO: `/v3/projects/d61df575e7af4d8c81db94d05ef51f2e/users/f0661a9971ea4830a2d248d7c02e5415/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:34.084332 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818d41e-9254-436f-87f0-f6a5edb1a138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61df575e7af4d8c81db94d05ef51f2e, user_id=f0661a9971ea4830a2d248d7c02e5415, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:34.087074 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818d41e-9254-436f-87f0-f6a5edb1a138 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:34.103708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1412/2824] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:05:34 2022] PUT /identity/v3/projects/d61df575e7af4d8c81db94d05ef51f2e/users/f0661a9971ea4830a2d248d7c02e5415/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:34.120457 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563ad4-ab97-4be7-9272-aaa025923288 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:34.120774 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563ad4-ab97-4be7-9272-aaa025923288 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:34.121052 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8563ad4-ab97-4be7-9272-aaa025923288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:34.149343 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-a8563ad4-ab97-4be7-9272-aaa025923288 None None] MFA Rules not processed for user `f0661a9971ea4830a2d248d7c02e5415`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:34.151114 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a8563ad4-ab97-4be7-9272-aaa025923288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:34.215479 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1413/2825] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:34 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:05:34.254196 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818d41e-9254-436f-87f0-f6a5edb1a138 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:34.256053 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9818d41e-9254-436f-87f0-f6a5edb1a138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:34.312664 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818d41e-9254-436f-87f0-f6a5edb1a138 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:34.316934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364ced7-36ae-439b-bdf6-dc99431f8aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:34.317601 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364ced7-36ae-439b-bdf6-dc99431f8aec service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:34.317874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364ced7-36ae-439b-bdf6-dc99431f8aec service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:34.318145 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364ced7-36ae-439b-bdf6-dc99431f8aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:34.326898 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364ced7-36ae-439b-bdf6-dc99431f8aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:34.328317 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364ced7-36ae-439b-bdf6-dc99431f8aec service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:34.337185 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1413/2826] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:34 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:34.351647 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563ad4-ab97-4be7-9272-aaa025923288 None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:34.415281 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8563ad4-ab97-4be7-9272-aaa025923288 None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:34.420773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:34.421698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:34.421975 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:34.422247 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] PATH_INFO: `/v3/users/f0661a9971ea4830a2d248d7c02e5415` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:34.423587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0661a9971ea4830a2d248d7c02e5415)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:34.425587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:34.474478 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0661a9971ea4830a2d248d7c02e5415'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:34.481060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0661a9971ea4830a2d248d7c02e5415'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:34.481765 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0661a9971ea4830a2d248d7c02e5415'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:34.482373 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0661a9971ea4830a2d248d7c02e5415'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:34.491326 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0661a9971ea4830a2d248d7c02e5415'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:34.509678 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1414/2827] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:05:34 2022] DELETE /identity/v3/users/f0661a9971ea4830a2d248d7c02e5415 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:34.514700 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916dcf-2bc8-4e8e-a97d-83118c0091c0 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:34.515195 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916dcf-2bc8-4e8e-a97d-83118c0091c0 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:34.515326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916dcf-2bc8-4e8e-a97d-83118c0091c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:34.532694 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-29916dcf-2bc8-4e8e-a97d-83118c0091c0 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:34.533934 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-29916dcf-2bc8-4e8e-a97d-83118c0091c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:34.597973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1414/2828] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:34.608187 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:34.609888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:34.673460 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ae89d-4879-4459-a0fd-59d16ec70ae3 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:34.677810 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a1be7-276b-463b-84ea-60c0cf591a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:34.678446 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a1be7-276b-463b-84ea-60c0cf591a88 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:34.678722 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a1be7-276b-463b-84ea-60c0cf591a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:34.678987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a1be7-276b-463b-84ea-60c0cf591a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:34.689082 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a1be7-276b-463b-84ea-60c0cf591a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:34.690553 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a1be7-276b-463b-84ea-60c0cf591a88 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:34.700432 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1415/2829] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:34.979097 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916dcf-2bc8-4e8e-a97d-83118c0091c0 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:34.980704 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-29916dcf-2bc8-4e8e-a97d-83118c0091c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:34.993385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916dcf-2bc8-4e8e-a97d-83118c0091c0 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:34.998713 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:34.999564 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:34.999839 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.000111 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] PATH_INFO: `/v3/projects/d61df575e7af4d8c81db94d05ef51f2e` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.001273 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61df575e7af4d8c81db94d05ef51f2e)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:35.003194 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:35.052114 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61df575e7af4d8c81db94d05ef51f2e', 'request_id': 'req-87d92feb-20c1-4c76-b0ec-d799817b1b69'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:35.058495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61df575e7af4d8c81db94d05ef51f2e', 'request_id': 'req-87d92feb-20c1-4c76-b0ec-d799817b1b69'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:35.066738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61df575e7af4d8c81db94d05ef51f2e', 'request_id': 'req-87d92feb-20c1-4c76-b0ec-d799817b1b69'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:35.076460 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] The token cache is being invalidate because project d61df575e7af4d8c81db94d05ef51f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:05:35.076750 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:35.077390 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-87d92feb-20c1-4c76-b0ec-d799817b1b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:35.078924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1415/2830] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:05:34 2022] DELETE /identity/v3/projects/d61df575e7af4d8c81db94d05ef51f2e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:35.084213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff6c13-4102-4652-b19f-eef5f6523e1f None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.084503 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff6c13-4102-4652-b19f-eef5f6523e1f None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.084780 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff6c13-4102-4652-b19f-eef5f6523e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.103380 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-13ff6c13-4102-4652-b19f-eef5f6523e1f None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:35.104697 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-13ff6c13-4102-4652-b19f-eef5f6523e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:35.173271 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1416/2831] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:35.181520 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39d873-0ead-4710-b821-bcc855e8d160 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.181812 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39d873-0ead-4710-b821-bcc855e8d160 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.182084 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39d873-0ead-4710-b821-bcc855e8d160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.201527 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-0e39d873-0ead-4710-b821-bcc855e8d160 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:35.202738 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0e39d873-0ead-4710-b821-bcc855e8d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:35.212098 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1416/2832] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:35.216443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff6c13-4102-4652-b19f-eef5f6523e1f None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:35.226165 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff6c13-4102-4652-b19f-eef5f6523e1f None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:35.231287 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bc747-209d-4d1e-9570-b51ae0a17e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:35.231946 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bc747-209d-4d1e-9570-b51ae0a17e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.232229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bc747-209d-4d1e-9570-b51ae0a17e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.232501 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bc747-209d-4d1e-9570-b51ae0a17e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.233236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bc747-209d-4d1e-9570-b51ae0a17e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:05:35.233587 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bc747-209d-4d1e-9570-b51ae0a17e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:35.235231 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bc747-209d-4d1e-9570-b51ae0a17e5b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:35.247283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1417/2833] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:05:35.251838 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39d873-0ead-4710-b821-bcc855e8d160 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:35.261199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39d873-0ead-4710-b821-bcc855e8d160 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:35.266040 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ea67-748f-4b62-904b-a1dce0ce8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:35.266689 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ea67-748f-4b62-904b-a1dce0ce8793 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.266973 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ea67-748f-4b62-904b-a1dce0ce8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.267305 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ea67-748f-4b62-904b-a1dce0ce8793 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.267977 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ea67-748f-4b62-904b-a1dce0ce8793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:35.269915 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ea67-748f-4b62-904b-a1dce0ce8793 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:35.297056 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1417/2834] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:05:35 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 19:05:35.301181 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bc747-209d-4d1e-9570-b51ae0a17e5b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:35.311374 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bc747-209d-4d1e-9570-b51ae0a17e5b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:35.370113 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc418c3-bccf-4bf6-9724-e4af3540cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:35.370785 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc418c3-bccf-4bf6-9724-e4af3540cb77 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.371063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc418c3-bccf-4bf6-9724-e4af3540cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.371334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc418c3-bccf-4bf6-9724-e4af3540cb77 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.372022 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc418c3-bccf-4bf6-9724-e4af3540cb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:35.374004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc418c3-bccf-4bf6-9724-e4af3540cb77 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:35.395612 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1418/2835] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:05:35 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:35.400062 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ea67-748f-4b62-904b-a1dce0ce8793 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:35.410464 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ea67-748f-4b62-904b-a1dce0ce8793 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:35.415338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef642-3937-40de-900c-a2e767886f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:35.415989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef642-3937-40de-900c-a2e767886f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.416266 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef642-3937-40de-900c-a2e767886f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.416534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef642-3937-40de-900c-a2e767886f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.417326 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef642-3937-40de-900c-a2e767886f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:35.418926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef642-3937-40de-900c-a2e767886f3b admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:35.429260 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1418/2836] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:35.433117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc418c3-bccf-4bf6-9724-e4af3540cb77 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:35.443969 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc418c3-bccf-4bf6-9724-e4af3540cb77 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:35.449869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5959ce5-affb-482f-87fe-08ab1428b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:35.450604 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959ce5-affb-482f-87fe-08ab1428b975 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.450794 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959ce5-affb-482f-87fe-08ab1428b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.451074 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959ce5-affb-482f-87fe-08ab1428b975 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.451827 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5959ce5-affb-482f-87fe-08ab1428b975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:35.453459 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5959ce5-affb-482f-87fe-08ab1428b975 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:35.464263 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1419/2837] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:35.468698 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef642-3937-40de-900c-a2e767886f3b admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:35.478904 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef642-3937-40de-900c-a2e767886f3b admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:35.484002 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdf9d3-c623-4cdc-b4b7-905a91d3f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:35.484885 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdf9d3-c623-4cdc-b4b7-905a91d3f711 admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.485165 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdf9d3-c623-4cdc-b4b7-905a91d3f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.485487 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdf9d3-c623-4cdc-b4b7-905a91d3f711 admin admin] PATH_INFO: `/v3/projects/1458174c08c34392b1ca1cc680c84919/users/11c1607e021c43cda9d8d5d46750fe75/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.501414 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdf9d3-c623-4cdc-b4b7-905a91d3f711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1458174c08c34392b1ca1cc680c84919, user_id=11c1607e021c43cda9d8d5d46750fe75, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:35.504110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdf9d3-c623-4cdc-b4b7-905a91d3f711 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:35.523146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1419/2838] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:05:35 2022] PUT /identity/v3/projects/1458174c08c34392b1ca1cc680c84919/users/11c1607e021c43cda9d8d5d46750fe75/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:35.537226 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9c0e-b9bd-4763-b2a2-d18bfac7de1d None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.537537 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9c0e-b9bd-4763-b2a2-d18bfac7de1d None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.537809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9c0e-b9bd-4763-b2a2-d18bfac7de1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.569508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-79fb9c0e-b9bd-4763-b2a2-d18bfac7de1d None None] MFA Rules not processed for user `11c1607e021c43cda9d8d5d46750fe75`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:35.570655 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-79fb9c0e-b9bd-4763-b2a2-d18bfac7de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:35.640636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1420/2839] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:35.652833 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdf9d3-c623-4cdc-b4b7-905a91d3f711 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:35.655011 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-decdf9d3-c623-4cdc-b4b7-905a91d3f711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:35.713691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdf9d3-c623-4cdc-b4b7-905a91d3f711 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:35.718536 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f590c9-653a-4c02-a144-a318917c7e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432759ff503942e7ae6941f9d4b951b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:35.719173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f590c9-653a-4c02-a144-a318917c7e16 service cinder] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:35.719447 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f590c9-653a-4c02-a144-a318917c7e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:35.719716 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f590c9-653a-4c02-a144-a318917c7e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:35.732498 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f590c9-653a-4c02-a144-a318917c7e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:35.734707 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f590c9-653a-4c02-a144-a318917c7e16 service cinder] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:35.747826 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1420/2840] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:43.821629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9c0e-b9bd-4763-b2a2-d18bfac7de1d None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:43.885737 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9c0e-b9bd-4763-b2a2-d18bfac7de1d None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:43.890968 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:43.891864 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:43.892145 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:43.892417 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] PATH_INFO: `/v3/users/11c1607e021c43cda9d8d5d46750fe75` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:43.893755 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c1607e021c43cda9d8d5d46750fe75)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:43.895693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:43.944557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c1607e021c43cda9d8d5d46750fe75'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:43.951177 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c1607e021c43cda9d8d5d46750fe75'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:43.951834 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c1607e021c43cda9d8d5d46750fe75'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:43.952420 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c1607e021c43cda9d8d5d46750fe75'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:43.960825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c1607e021c43cda9d8d5d46750fe75'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:43.978610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1421/2841] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:05:43 2022] DELETE /identity/v3/users/11c1607e021c43cda9d8d5d46750fe75 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:43.983047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f19a05-80cb-4e61-a2a1-10fa6409352a None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:43.983481 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f19a05-80cb-4e61-a2a1-10fa6409352a None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:43.983594 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f19a05-80cb-4e61-a2a1-10fa6409352a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.001192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-82f19a05-80cb-4e61-a2a1-10fa6409352a None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:44.002612 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-82f19a05-80cb-4e61-a2a1-10fa6409352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:44.060587 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1421/2842] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:44.070238 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:44.071643 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:44.128466 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce01825-6613-4ded-a7c1-960add552c9a admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:44.132766 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5510da-61f0-4866-afd3-632caa6981bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:44.133445 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5510da-61f0-4866-afd3-632caa6981bc service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:44.133725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5510da-61f0-4866-afd3-632caa6981bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:44.133992 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5510da-61f0-4866-afd3-632caa6981bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.143524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5510da-61f0-4866-afd3-632caa6981bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:44.144945 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5510da-61f0-4866-afd3-632caa6981bc service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:44.154073 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1422/2843] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:44.428298 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f19a05-80cb-4e61-a2a1-10fa6409352a None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:44.429849 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-82f19a05-80cb-4e61-a2a1-10fa6409352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:44.442312 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f19a05-80cb-4e61-a2a1-10fa6409352a None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:44.449701 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:44.450595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:44.450872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:44.451158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] PATH_INFO: `/v3/projects/1458174c08c34392b1ca1cc680c84919` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.452607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1458174c08c34392b1ca1cc680c84919)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:44.454560 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:44.507269 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1458174c08c34392b1ca1cc680c84919', 'request_id': 'req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:44.513180 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1458174c08c34392b1ca1cc680c84919', 'request_id': 'req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:44.522864 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1458174c08c34392b1ca1cc680c84919', 'request_id': 'req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:44.534335 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] The token cache is being invalidate because project 1458174c08c34392b1ca1cc680c84919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:05:44.534615 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:44.535240 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-9d81a88c-1506-497b-81ba-4ef6bfe2af0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:05:44.536810 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1422/2844] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:05:44 2022] DELETE /identity/v3/projects/1458174c08c34392b1ca1cc680c84919 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:05:44.542283 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c45b0-afc7-4567-9149-579c97bc62ec None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:44.542569 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c45b0-afc7-4567-9149-579c97bc62ec None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:44.542848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c45b0-afc7-4567-9149-579c97bc62ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.561707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-277c45b0-afc7-4567-9149-579c97bc62ec None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:44.562947 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-277c45b0-afc7-4567-9149-579c97bc62ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:44.620767 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1423/2845] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:44.629728 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db4728-b797-4273-b009-ac2c2e60fb41 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:44.630015 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db4728-b797-4273-b009-ac2c2e60fb41 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:44.630291 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db4728-b797-4273-b009-ac2c2e60fb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.649318 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-e2db4728-b797-4273-b009-ac2c2e60fb41 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:44.650533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-e2db4728-b797-4273-b009-ac2c2e60fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:44.659551 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1423/2846] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:44.663729 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c45b0-afc7-4567-9149-579c97bc62ec None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:44.673746 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c45b0-afc7-4567-9149-579c97bc62ec None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:44.678993 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4f5ae-0eaf-49ed-8e65-32897b24e81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:44.679650 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f5ae-0eaf-49ed-8e65-32897b24e81c admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:44.679935 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f5ae-0eaf-49ed-8e65-32897b24e81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:44.680327 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f5ae-0eaf-49ed-8e65-32897b24e81c admin admin] PATH_INFO: `/v3/domains` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.681066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f5ae-0eaf-49ed-8e65-32897b24e81c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 19:05:44.681407 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f5ae-0eaf-49ed-8e65-32897b24e81c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:44.683111 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f5ae-0eaf-49ed-8e65-32897b24e81c admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:44.694994 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1424/2847] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 4 19:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 19:05:44.699262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db4728-b797-4273-b009-ac2c2e60fb41 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:44.708495 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db4728-b797-4273-b009-ac2c2e60fb41 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:44.714202 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4784b-4840-4a95-b486-9ac34db0ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:44.714809 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4784b-4840-4a95-b486-9ac34db0ca42 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:44.715105 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4784b-4840-4a95-b486-9ac34db0ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:44.715374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4784b-4840-4a95-b486-9ac34db0ca42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.716094 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4784b-4840-4a95-b486-9ac34db0ca42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:44.718031 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4784b-4840-4a95-b486-9ac34db0ca42 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:44.747296 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1424/2848] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:05:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:44.753552 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4f5ae-0eaf-49ed-8e65-32897b24e81c admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:44.766825 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4f5ae-0eaf-49ed-8e65-32897b24e81c admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:44.839792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0be3-f21f-49c3-b5ee-3a6035615fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:44.840440 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0be3-f21f-49c3-b5ee-3a6035615fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:44.840716 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0be3-f21f-49c3-b5ee-3a6035615fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:44.840987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0be3-f21f-49c3-b5ee-3a6035615fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.841694 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d0be3-f21f-49c3-b5ee-3a6035615fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:44.843610 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d0be3-f21f-49c3-b5ee-3a6035615fd0 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:44.865580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1425/2849] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:05:44 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:44.923867 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4784b-4840-4a95-b486-9ac34db0ca42 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:44.939688 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4784b-4840-4a95-b486-9ac34db0ca42 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:44.948719 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce89ed-ff03-47a4-8ce2-be7ca2165eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:44.949418 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce89ed-ff03-47a4-8ce2-be7ca2165eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:44.949696 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce89ed-ff03-47a4-8ce2-be7ca2165eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:44.949959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce89ed-ff03-47a4-8ce2-be7ca2165eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.950691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce89ed-ff03-47a4-8ce2-be7ca2165eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:44.952292 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce89ed-ff03-47a4-8ce2-be7ca2165eb8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:44.962708 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1425/2850] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:44.967875 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0be3-f21f-49c3-b5ee-3a6035615fd0 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:44.978822 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0be3-f21f-49c3-b5ee-3a6035615fd0 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:44.985080 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2883b-503f-46b8-b192-f8bb62aea0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:44.985776 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2883b-503f-46b8-b192-f8bb62aea0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:44.986060 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2883b-503f-46b8-b192-f8bb62aea0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:44.986341 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2883b-503f-46b8-b192-f8bb62aea0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:44.987078 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2883b-503f-46b8-b192-f8bb62aea0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:44.989058 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2883b-503f-46b8-b192-f8bb62aea0b1 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:45.000161 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1426/2851] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:45.006630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce89ed-ff03-47a4-8ce2-be7ca2165eb8 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:45.018760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce89ed-ff03-47a4-8ce2-be7ca2165eb8 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:45.024856 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7e66a-47a8-4df1-ba0a-10f5459222ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:45.025783 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7e66a-47a8-4df1-ba0a-10f5459222ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:45.026058 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7e66a-47a8-4df1-ba0a-10f5459222ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:45.026330 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7e66a-47a8-4df1-ba0a-10f5459222ee admin admin] PATH_INFO: `/v3/projects/81a244b92c0244089fae6217754f5a02/users/742cbe24ff634dba92b5e6bef3c3bb95/roles/fda329dea4e7408c9791a6554d482329` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:45.042042 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7e66a-47a8-4df1-ba0a-10f5459222ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a244b92c0244089fae6217754f5a02, user_id=742cbe24ff634dba92b5e6bef3c3bb95, role_id=fda329dea4e7408c9791a6554d482329)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:45.044766 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7e66a-47a8-4df1-ba0a-10f5459222ee admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:45.060087 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1426/2852] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:05:45 2022] PUT /identity/v3/projects/81a244b92c0244089fae6217754f5a02/users/742cbe24ff634dba92b5e6bef3c3bb95/roles/fda329dea4e7408c9791a6554d482329 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:45.065269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d6bd-fc86-492c-b471-9a985ea62f26 None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:45.065693 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d6bd-fc86-492c-b471-9a985ea62f26 None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:45.066039 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d6bd-fc86-492c-b471-9a985ea62f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:45.084154 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-fb85d6bd-fc86-492c-b471-9a985ea62f26 None None] MFA Rules not processed for user `03485317eebc406bacc978bde43ff42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:45.085391 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fb85d6bd-fc86-492c-b471-9a985ea62f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:45.148567 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1427/2853] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:45.158337 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7e66a-47a8-4df1-ba0a-10f5459222ee admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:45.160135 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-cbb7e66a-47a8-4df1-ba0a-10f5459222ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:45.221607 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7e66a-47a8-4df1-ba0a-10f5459222ee admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:45.225618 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecfd22-0f0a-453b-a264-b7e87eab31a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:45.226281 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecfd22-0f0a-453b-a264-b7e87eab31a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:45.226563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecfd22-0f0a-453b-a264-b7e87eab31a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:45.226836 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecfd22-0f0a-453b-a264-b7e87eab31a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:45.235775 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecfd22-0f0a-453b-a264-b7e87eab31a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:45.237225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecfd22-0f0a-453b-a264-b7e87eab31a1 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:45.246978 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1427/2854] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:49.667177 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b2dc0-a716-46d4-bc1a-fbfe304fdcdb None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:49.667634 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b2dc0-a716-46d4-bc1a-fbfe304fdcdb None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:49.667734 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b2dc0-a716-46d4-bc1a-fbfe304fdcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:49.699890 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-c80b2dc0-a716-46d4-bc1a-fbfe304fdcdb None None] MFA Rules not processed for user `742cbe24ff634dba92b5e6bef3c3bb95`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:49.701213 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c80b2dc0-a716-46d4-bc1a-fbfe304fdcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:49.771463 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1428/2855] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:49.775988 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecfd22-0f0a-453b-a264-b7e87eab31a1 service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:49.785843 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecfd22-0f0a-453b-a264-b7e87eab31a1 service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:49.790465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2a0d1-440f-4de0-9ded-7080ea88f2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:49.791115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2a0d1-440f-4de0-9ded-7080ea88f2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:49.791391 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2a0d1-440f-4de0-9ded-7080ea88f2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:49.791661 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2a0d1-440f-4de0-9ded-7080ea88f2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:49.792379 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2a0d1-440f-4de0-9ded-7080ea88f2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:49.794429 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2a0d1-440f-4de0-9ded-7080ea88f2a8 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:49.822162 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1428/2856] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 4 19:05:49 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:49.826249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b2dc0-a716-46d4-bc1a-fbfe304fdcdb None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:49.837037 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b2dc0-a716-46d4-bc1a-fbfe304fdcdb None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:49.891826 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969b285-5b8c-4baa-af54-6536dda6723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:49.892637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969b285-5b8c-4baa-af54-6536dda6723b admin admin] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:49.892919 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969b285-5b8c-4baa-af54-6536dda6723b admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:49.893196 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969b285-5b8c-4baa-af54-6536dda6723b admin admin] PATH_INFO: `/v3/users` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:49.893931 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969b285-5b8c-4baa-af54-6536dda6723b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:49.895868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969b285-5b8c-4baa-af54-6536dda6723b admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:49.916197 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1429/2857] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 4 19:05:49 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 19:05:49.920360 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2a0d1-440f-4de0-9ded-7080ea88f2a8 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:49.931109 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2a0d1-440f-4de0-9ded-7080ea88f2a8 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:49.936070 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918c434-5e05-4546-9f01-93b84e3395c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:49.936751 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918c434-5e05-4546-9f01-93b84e3395c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:49.937030 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918c434-5e05-4546-9f01-93b84e3395c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:49.937576 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918c434-5e05-4546-9f01-93b84e3395c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:49.938511 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918c434-5e05-4546-9f01-93b84e3395c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:49.940307 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918c434-5e05-4546-9f01-93b84e3395c1 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:49.957803 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1429/2858] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:49.959708 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969b285-5b8c-4baa-af54-6536dda6723b admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:49.970607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969b285-5b8c-4baa-af54-6536dda6723b admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:49.975901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685cea-3b24-46a9-8ad6-d2b4f71bbc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:49.976816 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685cea-3b24-46a9-8ad6-d2b4f71bbc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:49.977084 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685cea-3b24-46a9-8ad6-d2b4f71bbc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:49.977390 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685cea-3b24-46a9-8ad6-d2b4f71bbc37 admin admin] PATH_INFO: `/v3/projects/8d878264f67e439bb744394adbb5c686/users/40abef228c7346ba940d2a589933f86f/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:49.993557 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0685cea-3b24-46a9-8ad6-d2b4f71bbc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d878264f67e439bb744394adbb5c686, user_id=40abef228c7346ba940d2a589933f86f, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:49.996225 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0685cea-3b24-46a9-8ad6-d2b4f71bbc37 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:50.011168 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1430/2859] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:05:49 2022] PUT /identity/v3/projects/8d878264f67e439bb744394adbb5c686/users/40abef228c7346ba940d2a589933f86f/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:50.015210 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918c434-5e05-4546-9f01-93b84e3395c1 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:50.025252 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918c434-5e05-4546-9f01-93b84e3395c1 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:50.080047 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b5e3-ee7e-4828-a7bc-b2b288403eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:50.080723 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b5e3-ee7e-4828-a7bc-b2b288403eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:50.081003 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b5e3-ee7e-4828-a7bc-b2b288403eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:50.081465 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b5e3-ee7e-4828-a7bc-b2b288403eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:50.082066 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7b5e3-ee7e-4828-a7bc-b2b288403eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:50.083661 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7b5e3-ee7e-4828-a7bc-b2b288403eaa admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:50.094043 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1430/2860] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 4 19:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 19:05:50.098222 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685cea-3b24-46a9-8ad6-d2b4f71bbc37 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:50.108629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685cea-3b24-46a9-8ad6-d2b4f71bbc37 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:50.113140 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73271298-c4d6-4eb6-9d17-4c5276620ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:50.114529 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271298-c4d6-4eb6-9d17-4c5276620ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:50.114797 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271298-c4d6-4eb6-9d17-4c5276620ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:50.115068 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271298-c4d6-4eb6-9d17-4c5276620ffb admin admin] PATH_INFO: `/v3/projects/8d878264f67e439bb744394adbb5c686/users/40abef228c7346ba940d2a589933f86f/roles/91a83250a647489fb1e2f0465776fbe3` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:50.117034 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73271298-c4d6-4eb6-9d17-4c5276620ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d878264f67e439bb744394adbb5c686, user_id=40abef228c7346ba940d2a589933f86f, role_id=91a83250a647489fb1e2f0465776fbe3)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:50.119738 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73271298-c4d6-4eb6-9d17-4c5276620ffb admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:50.130725 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1431/2861] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 4 19:05:50 2022] PUT /identity/v3/projects/8d878264f67e439bb744394adbb5c686/users/40abef228c7346ba940d2a589933f86f/roles/91a83250a647489fb1e2f0465776fbe3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:05:54.409718 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec9ef-344a-4f13-9b2c-287ae888663f None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:54.410655 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec9ef-344a-4f13-9b2c-287ae888663f None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:54.410942 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec9ef-344a-4f13-9b2c-287ae888663f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:54.439858 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-40fec9ef-344a-4f13-9b2c-287ae888663f None None] MFA Rules not processed for user `40abef228c7346ba940d2a589933f86f`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:54.441383 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-40fec9ef-344a-4f13-9b2c-287ae888663f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:54.518461 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1431/2862] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:05:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:54.531253 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73271298-c4d6-4eb6-9d17-4c5276620ffb admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:54.533131 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-73271298-c4d6-4eb6-9d17-4c5276620ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:54.589322 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73271298-c4d6-4eb6-9d17-4c5276620ffb admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:54.593880 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0ff7-6438-44f8-8d49-97369f7979f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63b338ae7e374ba5a7542c5a53deb416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:54.594530 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0ff7-6438-44f8-8d49-97369f7979f4 service glance] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:54.594809 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0ff7-6438-44f8-8d49-97369f7979f4 service glance] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:54.595079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0ff7-6438-44f8-8d49-97369f7979f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:54.655970 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0ff7-6438-44f8-8d49-97369f7979f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:54.657447 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0ff7-6438-44f8-8d49-97369f7979f4 service glance] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:54.666378 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1432/2863] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:05:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:05:54.771507 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf643e-5b4a-4dfa-b073-cc4b71423ec9 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:54.771800 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf643e-5b4a-4dfa-b073-cc4b71423ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:54.772081 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf643e-5b4a-4dfa-b073-cc4b71423ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:54.790338 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-49bf643e-5b4a-4dfa-b073-cc4b71423ec9 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:05:54.791921 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-49bf643e-5b4a-4dfa-b073-cc4b71423ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:54.856061 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1432/2864] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 19:05:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:05:54.909198 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0ff7-6438-44f8-8d49-97369f7979f4 service glance] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:05:54.910896 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-3e5c0ff7-6438-44f8-8d49-97369f7979f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:05:54.984415 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0ff7-6438-44f8-8d49-97369f7979f4 service glance] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:05:54.989803 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa5de1-937a-404d-9b91-c186b694d47c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:05:54.990790 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa5de1-937a-404d-9b91-c186b694d47c service swift] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:05:54.991137 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa5de1-937a-404d-9b91-c186b694d47c service swift] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:05:54.991517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa5de1-937a-404d-9b91-c186b694d47c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:05:55.000869 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa5de1-937a-404d-9b91-c186b694d47c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:05:55.002898 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa5de1-937a-404d-9b91-c186b694d47c service swift] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:05:55.011638 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1433/2865] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:05:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:06:04.101647 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fd078-41a8-4f2b-a15f-3dcb55d16157 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:04.102209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fd078-41a8-4f2b-a15f-3dcb55d16157 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:04.102209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fd078-41a8-4f2b-a15f-3dcb55d16157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:04.125792 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-5a1fd078-41a8-4f2b-a15f-3dcb55d16157 None None] MFA Rules not processed for user `742cbe24ff634dba92b5e6bef3c3bb95`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:04.127007 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-5a1fd078-41a8-4f2b-a15f-3dcb55d16157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:04.134569 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1433/2866] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:06:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:06:05.859236 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657e95-5cba-4a0e-8649-df0c0586323b None None] REQUEST_METHOD: `POST` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:05.860047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657e95-5cba-4a0e-8649-df0c0586323b None None] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:05.860489 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657e95-5cba-4a0e-8649-df0c0586323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:05.879623 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.auth.core [None req-79657e95-5cba-4a0e-8649-df0c0586323b None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:06:05.880814 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-79657e95-5cba-4a0e-8649-df0c0586323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:05.888377 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1434/2867] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 4 19:06:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 19:06:05.901894 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fd078-41a8-4f2b-a15f-3dcb55d16157 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:05.916000 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fd078-41a8-4f2b-a15f-3dcb55d16157 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:05.920986 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12284d-59cb-4bcc-aa53-ae2fa1dcdec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:05.921691 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12284d-59cb-4bcc-aa53-ae2fa1dcdec5 service swift] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:05.921966 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12284d-59cb-4bcc-aa53-ae2fa1dcdec5 service swift] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:05.922235 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12284d-59cb-4bcc-aa53-ae2fa1dcdec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:05.930430 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12284d-59cb-4bcc-aa53-ae2fa1dcdec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:05.932183 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12284d-59cb-4bcc-aa53-ae2fa1dcdec5 service swift] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:05.940595 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1434/2868] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:06:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:06:09.953921 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79657e95-5cba-4a0e-8649-df0c0586323b None None] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:09.955910 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-79657e95-5cba-4a0e-8649-df0c0586323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:10.025888 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79657e95-5cba-4a0e-8649-df0c0586323b None None] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:10.030804 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:10.031823 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.032205 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.032594 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] PATH_INFO: `/v3/users/60a62451b6cc43c9a275a7d7c06bf4fd` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.033934 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a62451b6cc43c9a275a7d7c06bf4fd)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:10.035987 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:10.086773 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a62451b6cc43c9a275a7d7c06bf4fd'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.093176 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a62451b6cc43c9a275a7d7c06bf4fd'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.093942 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a62451b6cc43c9a275a7d7c06bf4fd'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.094580 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a62451b6cc43c9a275a7d7c06bf4fd'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.102221 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a62451b6cc43c9a275a7d7c06bf4fd'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.122254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1435/2869] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:06:09 2022] DELETE /identity/v3/users/60a62451b6cc43c9a275a7d7c06bf4fd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:10.317596 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12284d-59cb-4bcc-aa53-ae2fa1dcdec5 service swift] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:10.338262 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12284d-59cb-4bcc-aa53-ae2fa1dcdec5 service swift] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:10.405565 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:10.406445 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:10.406914 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:10.407190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] PATH_INFO: `/v3/projects/2f8f54a0a02a48a7a27e4b9474d4787f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:10.408428 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8f54a0a02a48a7a27e4b9474d4787f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:10.410382 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:10.476054 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8f54a0a02a48a7a27e4b9474d4787f', 'request_id': 'req-793e559d-b175-4d50-ad10-d1550bce9596'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.482840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8f54a0a02a48a7a27e4b9474d4787f', 'request_id': 'req-793e559d-b175-4d50-ad10-d1550bce9596'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.491351 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8f54a0a02a48a7a27e4b9474d4787f', 'request_id': 'req-793e559d-b175-4d50-ad10-d1550bce9596'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.501534 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] The token cache is being invalidate because project 2f8f54a0a02a48a7a27e4b9474d4787f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:06:10.501819 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.502488 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:06:10.504034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1435/2870] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:06:10 2022] DELETE /identity/v3/projects/2f8f54a0a02a48a7a27e4b9474d4787f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:06:30.289047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:30.290642 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:30.354249 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c115a5-058f-45e9-944a-8901e30af011 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:30.405879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:30.406524 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:30.406851 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:30.407129 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:30.409066 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:30.472117 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:30.473608 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:30.482985 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1436/2871] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:06:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:56.959575 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:56.961459 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:56.975192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e559d-b175-4d50-ad10-d1550bce9596 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:56.979582 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29b803-246d-400d-9c72-5b999e629e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:56.980274 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29b803-246d-400d-9c72-5b999e629e34 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:56.980554 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29b803-246d-400d-9c72-5b999e629e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:56.980822 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29b803-246d-400d-9c72-5b999e629e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:56.982795 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ff29b803-246d-400d-9c72-5b999e629e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:57.053726 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29b803-246d-400d-9c72-5b999e629e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:57.055110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29b803-246d-400d-9c72-5b999e629e34 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:57.066059 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1436/2872] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:06:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:06:58.256079 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:06:58.257640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.268597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a2ad-53fc-49f2-9ea8-bf972b3a6d11 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:06:58.272640 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:06:58.273337 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:06:58.273603 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:06:58.273897 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:06:58.275832 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:06:58.290276 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:06:58.291741 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:06:58.303237 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1437/2873] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:06:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:20.777467 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92160928-e136-458a-adf7-d651b9357652 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:20.778115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92160928-e136-458a-adf7-d651b9357652 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:20.778115 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92160928-e136-458a-adf7-d651b9357652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:20.795372 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-92160928-e136-458a-adf7-d651b9357652 None None] MFA Rules not processed for user `45ce0414c1e84e52ad6dc6f840e4f658`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:20.796577 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-92160928-e136-458a-adf7-d651b9357652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:20.853014 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1437/2874] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:07:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:21.663458 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:21.665004 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:21.734481 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83326-d061-43ca-b046-b709722deb81 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:21.740350 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6eaf63f68734bdd938aa0ea7d0c4441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:21.741001 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:21.741269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:21.741572 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:21.743443 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:21.754735 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:21.756346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:21.766262 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1438/2875] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:07:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:23.405580 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92160928-e136-458a-adf7-d651b9357652 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:23.416250 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92160928-e136-458a-adf7-d651b9357652 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:23.420457 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ed1b8-abfa-49c0-ae4c-44b4d7b25ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:23.421173 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ed1b8-abfa-49c0-ae4c-44b4d7b25ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:23.421602 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ed1b8-abfa-49c0-ae4c-44b4d7b25ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:23.421924 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ed1b8-abfa-49c0-ae4c-44b4d7b25ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:23.424023 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-4d9ed1b8-abfa-49c0-ae4c-44b4d7b25ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:23.434891 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ed1b8-abfa-49c0-ae4c-44b4d7b25ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:23.436396 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ed1b8-abfa-49c0-ae4c-44b4d7b25ac9 service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:23.445824 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1438/2876] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:07:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:32.803597 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:32.805411 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:32.822178 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5110554-7900-44a9-822c-b60c6fb4a77c service placement] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:32.828013 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:32.828698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:32.828966 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:32.829244 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:32.831027 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:32.843188 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:32.844821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:32.855483 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1439/2877] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:07:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:07:54.436627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4743d1-0d85-4baf-971d-42d583d69531 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:54.437110 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4743d1-0d85-4baf-971d-42d583d69531 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:54.437261 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4743d1-0d85-4baf-971d-42d583d69531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:54.457959 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-ad4743d1-0d85-4baf-971d-42d583d69531 None None] MFA Rules not processed for user `86da4c4a11d74550aa59449b1bc5ca3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:07:54.458760 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ad4743d1-0d85-4baf-971d-42d583d69531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:54.522190 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1439/2878] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 4 19:07:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:07:54.566644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:07:54.568155 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:07:54.638707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b6054-1751-42ac-a6e2-d74699ba7898 service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:07:54.644873 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b4718-0d01-412e-bd66-8aa7c2f6bec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd94a895e3a3547ff9cf35d808c595071', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:07:54.645550 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b4718-0d01-412e-bd66-8aa7c2f6bec9 service swift] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:07:54.645891 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b4718-0d01-412e-bd66-8aa7c2f6bec9 service swift] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:07:54.646146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b4718-0d01-412e-bd66-8aa7c2f6bec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:07:54.654644 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b4718-0d01-412e-bd66-8aa7c2f6bec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:07:54.656229 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b4718-0d01-412e-bd66-8aa7c2f6bec9 service swift] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:07:54.664054 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1440/2879] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 4 19:07:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 19:08:01.535452 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4743d1-0d85-4baf-971d-42d583d69531 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:01.536900 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-ad4743d1-0d85-4baf-971d-42d583d69531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:01.606385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4743d1-0d85-4baf-971d-42d583d69531 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:01.611073 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:01.612051 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:01.612394 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:01.612733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] PATH_INFO: `/v3/users/742cbe24ff634dba92b5e6bef3c3bb95` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:01.614034 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742cbe24ff634dba92b5e6bef3c3bb95)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:01.616627 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:01.663563 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742cbe24ff634dba92b5e6bef3c3bb95'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:01.669965 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742cbe24ff634dba92b5e6bef3c3bb95'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:01.670605 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742cbe24ff634dba92b5e6bef3c3bb95'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:01.671192 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742cbe24ff634dba92b5e6bef3c3bb95'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:01.680926 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742cbe24ff634dba92b5e6bef3c3bb95'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:01.697566 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1440/2880] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:08:01 2022] DELETE /identity/v3/users/742cbe24ff634dba92b5e6bef3c3bb95 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:08:01.881879 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b4718-0d01-412e-bd66-8aa7c2f6bec9 service swift] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:01.894406 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b4718-0d01-412e-bd66-8aa7c2f6bec9 service swift] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:01.954901 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:01.955792 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:01.956070 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:01.956334 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] PATH_INFO: `/v3/projects/81a244b92c0244089fae6217754f5a02` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:01.957539 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a244b92c0244089fae6217754f5a02)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:01.959433 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:02.004599 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a244b92c0244089fae6217754f5a02', 'request_id': 'req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.013546 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a244b92c0244089fae6217754f5a02', 'request_id': 'req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.020024 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a244b92c0244089fae6217754f5a02', 'request_id': 'req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.030423 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] The token cache is being invalidate because project 81a244b92c0244089fae6217754f5a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:08:02.030707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.031346 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.033758 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1441/2881] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:08:01 2022] DELETE /identity/v3/projects/81a244b92c0244089fae6217754f5a02 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:08:02.039989 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:02.041840 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:02.059651 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fede4-ddbb-477d-962d-a71cab6eae74 admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:02.121550 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:02.122438 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:02.122721 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:02.122999 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] PATH_INFO: `/v3/users/40abef228c7346ba940d2a589933f86f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:02.124225 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40abef228c7346ba940d2a589933f86f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:02.126199 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:02.173874 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40abef228c7346ba940d2a589933f86f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.181153 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40abef228c7346ba940d2a589933f86f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.182086 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40abef228c7346ba940d2a589933f86f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.182933 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40abef228c7346ba940d2a589933f86f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.191975 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-c8b0045a-cd8c-4e04-b7e8-7e1059a17117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40abef228c7346ba940d2a589933f86f'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.215543 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1441/2882] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:08:02 2022] DELETE /identity/v3/users/40abef228c7346ba940d2a589933f86f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:08:02.393960 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:08:02.395506 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:08:02.410184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be2ed5-8fd8-4f5e-8a35-43bb0bbcf50e admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:08:02.469964 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:08:02.470846 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:08:02.471128 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:08:02.471424 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] PATH_INFO: `/v3/projects/8d878264f67e439bb744394adbb5c686` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:08:02.472652 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d878264f67e439bb744394adbb5c686)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:08:02.474607 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:08:02.522127 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d878264f67e439bb744394adbb5c686', 'request_id': 'req-6d490227-2a76-4903-b65c-e374ffbcb588'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.531234 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d878264f67e439bb744394adbb5c686', 'request_id': 'req-6d490227-2a76-4903-b65c-e374ffbcb588'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.537723 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d878264f67e439bb744394adbb5c686', 'request_id': 'req-6d490227-2a76-4903-b65c-e374ffbcb588'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.548974 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] The token cache is being invalidate because project 8d878264f67e439bb744394adbb5c686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:08:02.549259 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.549997 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:08:02.551672 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1442/2883] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:08:02 2022] DELETE /identity/v3/projects/8d878264f67e439bb744394adbb5c686 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 19:09:15.643166 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8d16-0f54-42e1-8c86-edd460ddadf7 None None] REQUEST_METHOD: `POST` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:15.643767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8d16-0f54-42e1-8c86-edd460ddadf7 None None] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:15.643767 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8d16-0f54-42e1-8c86-edd460ddadf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:15.671746 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.auth.core [None req-d5ec8d16-0f54-42e1-8c86-edd460ddadf7 None None] MFA Rules not processed for user `45ce0414c1e84e52ad6dc6f840e4f658`. Rule list: `[]` (Enabled: `True`). {{(pid=79826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 19:09:15.672938 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d5ec8d16-0f54-42e1-8c86-edd460ddadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:15.753879 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1442/2884] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 4 19:09:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 19:09:16.086564 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:09:16.088040 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:16.171843 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d490227-2a76-4903-b65c-e374ffbcb588 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:09:16.177936 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf4c4e-216e-4891-bdd7-2c7fa7056f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:09:16.178589 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf4c4e-216e-4891-bdd7-2c7fa7056f58 service neutron] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:16.178872 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf4c4e-216e-4891-bdd7-2c7fa7056f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:16.179146 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf4c4e-216e-4891-bdd7-2c7fa7056f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:16.181707 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-95bf4c4e-216e-4891-bdd7-2c7fa7056f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:16.196268 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf4c4e-216e-4891-bdd7-2c7fa7056f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:09:16.198491 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf4c4e-216e-4891-bdd7-2c7fa7056f58 service neutron] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:09:16.209991 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1443/2885] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:09:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:09:18.938535 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8d16-0f54-42e1-8c86-edd460ddadf7 None None] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:09:18.940020 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-d5ec8d16-0f54-42e1-8c86-edd460ddadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:19.045533 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8d16-0f54-42e1-8c86-edd460ddadf7 None None] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:09:19.051038 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a8c91-49dd-4e78-b0fc-96b941494cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:09:19.051757 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a8c91-49dd-4e78-b0fc-96b941494cac service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:19.052041 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a8c91-49dd-4e78-b0fc-96b941494cac service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:19.052311 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a8c91-49dd-4e78-b0fc-96b941494cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:19.054796 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-243a8c91-49dd-4e78-b0fc-96b941494cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:19.068065 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a8c91-49dd-4e78-b0fc-96b941494cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:09:19.069827 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a8c91-49dd-4e78-b0fc-96b941494cac service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:09:19.081574 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1443/2886] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:09:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:09:21.242192 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf4c4e-216e-4891-bdd7-2c7fa7056f58 service neutron] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:09:21.261532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf4c4e-216e-4891-bdd7-2c7fa7056f58 service neutron] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:09:21.268637 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:09:21.269295 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:21.269601 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:21.269868 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:21.272050 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:21.283379 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:09:21.284957 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:09:21.294280 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1444/2887] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:09:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:09:34.409630 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a8c91-49dd-4e78-b0fc-96b941494cac service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:09:34.428724 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a8c91-49dd-4e78-b0fc-96b941494cac service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:09:34.435663 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938216005694c45bd6126415930d014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:09:34.436435 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:09:34.436787 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:09:34.437129 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:09:34.439374 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:09:34.452158 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:09:34.454039 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:09:34.464939 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1444/2888] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:09:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:10:09.296959 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:10:09.298621 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:09.387629 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60b7b1-01e1-4e39-9a05-fb9a8c06f7df service nova] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:10:09.392532 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6eaf63f68734bdd938aa0ea7d0c4441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:10:09.393210 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:10:09.393517 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:10:09.393789 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:10:09.395636 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:10:09.407216 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:10:09.408805 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:10:09.418752 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1445/2889] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:10:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:19.457209 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:19.458872 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:19.493853 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670a8df-3e3a-4e10-9e3c-7e258bf9dd1b service nova] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:19.498025 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945fca7-e2fc-4578-acdb-9b8afc35736d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b338c27d664f51bc9de29c9c6ba40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:19.498676 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945fca7-e2fc-4578-acdb-9b8afc35736d service neutron] REQUEST_METHOD: `GET` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:19.498961 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945fca7-e2fc-4578-acdb-9b8afc35736d service neutron] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:19.499239 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945fca7-e2fc-4578-acdb-9b8afc35736d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:19.501234 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-6945fca7-e2fc-4578-acdb-9b8afc35736d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:19.599416 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945fca7-e2fc-4578-acdb-9b8afc35736d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:19.600865 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945fca7-e2fc-4578-acdb-9b8afc35736d service neutron] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:19.621078 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1445/2890] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 19:11:26.149882 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:26.151428 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:26.166063 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174e603-8f15-41d9-8ae5-0561bba45c1a service placement] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:26.170698 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:26.171582 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:26.171863 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:26.172134 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] PATH_INFO: `/v3/users/45ce0414c1e84e52ad6dc6f840e4f658` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:26.173508 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ce0414c1e84e52ad6dc6f840e4f658)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:26.175462 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:26.223498 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ce0414c1e84e52ad6dc6f840e4f658'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.230184 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ce0414c1e84e52ad6dc6f840e4f658'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.230848 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ce0414c1e84e52ad6dc6f840e4f658'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.231464 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ce0414c1e84e52ad6dc6f840e4f658'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.239254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ce0414c1e84e52ad6dc6f840e4f658'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.255798 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1446/2891] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:11:26 2022] DELETE /identity/v3/users/45ce0414c1e84e52ad6dc6f840e4f658 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:11:26.450407 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945fca7-e2fc-4578-acdb-9b8afc35736d service neutron] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:26.460447 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945fca7-e2fc-4578-acdb-9b8afc35736d service neutron] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:26.527168 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:26.528413 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:26.528733 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:26.529050 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] PATH_INFO: `/v3/projects/8e0c53091dab4ba790155c256f29db1f` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:26.530821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0c53091dab4ba790155c256f29db1f)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:26.533531 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:26.587144 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0c53091dab4ba790155c256f29db1f', 'request_id': 'req-0afc55cd-0acf-4a24-910a-f8625b7d30db'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.593558 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0c53091dab4ba790155c256f29db1f', 'request_id': 'req-0afc55cd-0acf-4a24-910a-f8625b7d30db'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.602057 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0c53091dab4ba790155c256f29db1f', 'request_id': 'req-0afc55cd-0acf-4a24-910a-f8625b7d30db'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.612103 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] The token cache is being invalidate because project 8e0c53091dab4ba790155c256f29db1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:11:26.612385 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.613027 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.614581 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1446/2892] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:11:26 2022] DELETE /identity/v3/projects/8e0c53091dab4ba790155c256f29db1f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:11:26.619254 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:26.620795 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:26.635899 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac317880-f1a3-4fa2-9524-cef6138987e3 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:26.689943 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:26.690740 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:26.691015 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:26.691284 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] PATH_INFO: `/v3/users/383db515377f4d979257201227cc87a4` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:26.692651 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=383db515377f4d979257201227cc87a4)` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:26.694622 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:26.752076 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383db515377f4d979257201227cc87a4'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.762047 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383db515377f4d979257201227cc87a4'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.762941 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383db515377f4d979257201227cc87a4'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.763791 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383db515377f4d979257201227cc87a4'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.775269 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.notifications [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383db515377f4d979257201227cc87a4'} {{(pid=79827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:26.798937 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1447/2893] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 4 19:11:26 2022] DELETE /identity/v3/users/383db515377f4d979257201227cc87a4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:11:26.979197 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] Authenticating user token {{(pid=79826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:11:26.980737 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.fernet_utils [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:11:26.994213 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc55cd-0acf-4a24-910a-f8625b7d30db admin admin] Validating token access rules against request {{(pid=79826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:11:27.053246 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03485317eebc406bacc978bde43ff42a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4308e1d2b884e0c9079dd2577f0b370', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:11:27.054176 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:11:27.054458 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] SCRIPT_NAME: `/identity` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:11:27.054730 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] PATH_INFO: `/v3/projects/df88434689bc42f28ac209a7140d2e87` {{(pid=79826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:11:27.056012 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df88434689bc42f28ac209a7140d2e87)` {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:11:27.058021 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] RBAC: Authorization granted {{(pid=79826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:11:27.108112 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df88434689bc42f28ac209a7140d2e87', 'request_id': 'req-23c498a9-3fac-4fd6-94b9-0be21e82082c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:27.114146 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df88434689bc42f28ac209a7140d2e87', 'request_id': 'req-23c498a9-3fac-4fd6-94b9-0be21e82082c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:27.122821 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df88434689bc42f28ac209a7140d2e87', 'request_id': 'req-23c498a9-3fac-4fd6-94b9-0be21e82082c'} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:27.132516 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] The token cache is being invalidate because project df88434689bc42f28ac209a7140d2e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 19:11:27.132797 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:27.133432 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: DEBUG keystone.notifications [None req-23c498a9-3fac-4fd6-94b9-0be21e82082c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 19:11:27.134960 dv-cinder-840525-1-iscsi devstack@keystone.service[79826]: [pid: 79826|app: 0|req: 1447/2894] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 4 19:11:26 2022] DELETE /identity/v3/projects/df88434689bc42f28ac209a7140d2e87 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 19:15:16.269754 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] Authenticating user token {{(pid=79827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 19:15:16.271421 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:16.353990 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb0878-8da4-466c-a4ea-9481e421b753 admin admin] Validating token access rules against request {{(pid=79827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 19:15:16.424821 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dd1bb-dca2-40cc-8510-f069d46f6b7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6eaf63f68734bdd938aa0ea7d0c4441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b43ce1e064744e0b92d841d7b2bae65', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 19:15:16.425510 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dd1bb-dca2-40cc-8510-f069d46f6b7a service placement] REQUEST_METHOD: `GET` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 19:15:16.425788 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dd1bb-dca2-40cc-8510-f069d46f6b7a service placement] SCRIPT_NAME: `/identity` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 19:15:16.426055 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dd1bb-dca2-40cc-8510-f069d46f6b7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 19:15:16.428144 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.fernet_utils [None req-001dd1bb-dca2-40cc-8510-f069d46f6b7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 19:15:16.439540 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dd1bb-dca2-40cc-8510-f069d46f6b7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 19:15:16.441252 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dd1bb-dca2-40cc-8510-f069d46f6b7a service placement] RBAC: Authorization granted {{(pid=79827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 19:15:16.452435 dv-cinder-840525-1-iscsi devstack@keystone.service[79827]: [pid: 79827|app: 0|req: 1448/2895] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 4 19:15:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)